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(54) Information provider apparatus enabling selective playing of multimedia information by 
interactive input based on displayed hypertext information 



(57) An information provider apparatus, enabling a 
user to employ hyperlink selection from a displayed 
hypertext data page to obtain and play the contents of 
specific sets of multimedia data which are held in a data 
storage device, executes control of playing of a set 
(101) based upon elapsed frame numbers of a video 
clip (1 02) which forms part of the set, in conjunction with 
scenario data which have been predetermined for the 
set. The apparatus can be used in a network in which 
users of various client terminals can access multimedia 



data stored at a server computer, or can exchange elec- 
tronic mail items each consisting of a set of multimedia 
data (101) in conjunction with corresponding scenario 
data, or can post messages on a "notice board" hyper- 
text page at a server computer, each message consist- 
ing of a set of multimedia data and corresponding 
scenario data, with other users of the network being 
able to access the posted messages by browsing selec- 
tion. 
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Description 

The present invention relates to an information pro- 
vider apparatus whereby a user can selectively obtain 
and play various types of data, with the selection being 
performed interactively based on hypertext data which 
are displayed to the user. 

In particular, the invention relates to such an infor- 
mation provider apparatus whereby the provided data 
can consist of a plurality of different types of monome- 
dia data, which can be played simultaneously to provide 
a multimedia data presentation, whereby the monome- 
dia data can include data such as video or audio data 
which are of continuous (i.e. time-varying) type, and 
whereby such data can be selected and played by the 
user with no substantial delay occurring between the 
time at which the user executes the selection and the 
time at which playing of that data begins, even if the 
data are stored at a remote location. 

In recent years, use of hypertext data has become 
widespread in the field of data processing display tech- 
nology. Hypertext data consist of units of pages, which 
can be successively acquired (i.e. by readout from 
memory) and displayed. Each page of the data contains 
one or more embedded text elements each of which 
points to some other page of the hypertext data, or to a 
data f ile which is stored in memory, such that selection 
of an embedded element by a user will result in the cor- 
responding page being displayed, or the corresponding 
file data being read out and played. (It should be noted 
that the term "played" as used in the following descrip- 
tion and appended claims is intended to have the mean- 
ing "displayed", when applied to text data or still picture 
data, and the meaning "played, providing a continuous- 
motion picture", when applied to video data). Such link- 
ing connections from an embedded text element in a 
hypertext page to some other hypertext data page or to 
a monomedia data file are often referred to as hyper- 
links, and that term will be used in the following. When a 
hypertext page is displayed, the user can activate a 
hyperlink, (generally by using a pointing device such as 
a mouse) by specifying the display screen region where 
the embedded hyperlink text element appears. In the 
following, the term "data item" will be applied to refer to 
such objects as a hypertext page, the contents of a 
monomedia data file (such as a text document, a video 
clip, and audio clip, etc.), and a region of a hypertext 
page that is used to activate a hyperlink will be referred 
to as an item selection region. 

Hypertext data are thus convenient for use in a sys- 
tem in which one or more client terminals are connected 
by respective data transmission paths or a network to a 
server computer, which may be a server of a wide-area 
network, such as a Web server of the Internet, or a 
server of an intra-organization "intranet". Information 
stored in memory at the server computer may be made 
available in common to each of the client terminals. Wrth 
the Internet or an "intranet", client terminals communi- 
cate with a server computer on the basis of on hyper- 
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links, i.e. using the HTTP (Hypertext Transfer Protocol) 
for data transfer between server and client terminals, 
and with hypertext data being expressed in HTML 
(Hypertext Markup Language). When a user of a client 

s terminal selects a hypeiiinked data item in a displayed 
page, then the selected data item (hypertext data page 
or monomedia data file) is downloaded from the server 
computer, i.e. is read out from memory at the server 
computer, transferred via a data communication path to 

to the client terminal, stored in memory at the client termi- 
nal, and can then be played by the user. 

In the following, an example of a prior art type of 
information provider appparatus will be described. This 
may be configured as a client terminal linked by a data 

is communication path to a server computer. Since hyper- 
text data and monomedia data (as defined above) are 
the types of data which are transferred via the World 
Wide Web. hypertext data and monomedia data which 
are stored and managed in such a way that hypertext 

20 data pages and monomedia data files can be accessed 
by a user via respective hyperlinks (from a displayed 
hypertext page) will be collectively referred to in the fol- 
lowing as WWW data. However it should be empha- 
sized that the term "WWW data" is used in that manner 

25 only for convenience of description when referring to a 
specific class of data, and does not in any way limit the 
present invention to use with the World Wide Web or the 
Internet. 

Fig. 66 is a system block diagram which shows the 
30 basic configuration of the prior art information provider 
apparatus example. In Fig. 66, a WWW data service 
section 3 is formed of a WWW data management sec- 
tion 32 and WWW data storage section 31 , and is cou- 
pled via a data communication path 4 to an information 

35 browsing section 2, which can be controlled by a user by 
means of an I/O section 1 . The I/O section 1 and infor- 
mation browsing section 2, in combination, may consti- 
tute a client terminal, with the WWW data service 
section 3 constituting a server computer. The I/O sec- 

40 tion 1 includes an input apparatus 11. which receives 
operation inputs from a user, and a display apparatus 
12 which serves to output to the user various types of 
media data, i.e. make the data visible or audible to the 
user as the data are being played. Hence it should be 

45 understood that the display apparatus 1 2 in general rep- 
resents a combination of such types of apparatus as a 
video display device, audio amplifier and loudspeaker, 
etc. The input apparatus 1 1 generally consists of a key- 
board, together with a pointing device such as a mouse. 

50 The information browsing section 2 includes a 
browsing control section 21 which serves to obtain, from 
the WWW data service section 3, WWW data which 
have been selected by the user by means of the input 
apparatus 11. The information browsing section 2 fur- 

55 ther includes an acquired data storage section 22, for 
holding downloaded WWW data, and a monomedia 
data playing section 23 which controls playing of the 
WWW data. 

The WWW data service section 3 is made up of a 
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WWW data storage section 31 , such as a high-capacity 
hard disk data storage device, and a WWW data man- 
agement section 32 which outputs specific parts of the 
WWW data (i.e. in units of hypertext data pages or data 
files) to the data communication path 4 in accordance 5 
with requests which are sent from the information 
browsing section 2 via the data communication path 4. 
Such requests are generated based on hyperlink selec- 
tion operations executed using the input apparatus 1 1 . 

The data communication path 4 operates on the 10 
basis of a HTTP communication system 41, which con- 
trols communication between the server computer and 
the client terminal, i.e. controls transfer of downloading 
requests from the client terminal to the server computer, 
and the transferring of requested hypertext data pages is 
or monomedia data files from the server computer to the 
client terminal. Specifically, the HTTP communication 
system 41 of Fig. 66 conceptually represents a combi- 
nation of software (programs) and hardware which are 
used by , the browsing control section 21 and WWW data 20 
management section 32 to implement communication 
via the data communication path 4 by using the HTTP 
protocol. 

Fig. 67 shows an example of the format of a page of 
WWW data that is expressed in HTML, as used by such 25 
a prior art type of information provider apparatus. As 
shown, the page has the name "samplahtml\ it con- 
tains a hyperlink to another hypertext data page, named 
"pics.htmr, in the ninth line, and a hyperlink to a video 
data file having the file name "movs.mpeg" in the twelfth 30 
line. 

Fig. 68 shows an example of the configuration of a 
playing; control table 24 which is held in the browsing 
control section 21 of the information browsing section 2. 
The table consists of a set of records, each representing 35 
a type of data file (or hypertext page unit) which can be 
held by the information browsing section 2. Each of the 
records has the following components: 

(1) File extension. 40 

This is the file name extension which is used in the 
name of that type of file, or in the name of a hypertext 
page. 

45 

(2) Data type 

This indicates the format of the data in each of the 
corresponding files. 

so 

(3) Player 

This specifies the name of the application program 
which is invoked to play the data of the corresponding 
files. rf no player is specified, then this signifies that the 55 
data are played by the browsing control section 21 , as is 
the case with HTML data. 

Thus for example in Fig. 68, each file having the file 
extension ".giP contains data expressing still pictures, in 



the GIF format, and the player program is specified as 
the "xv" program, in addition each file having the file 
extension ".mpeg" contains video data, in a com- 
pressed video data format such as the MPEG (or 
MPEG2) format and the corresponding player program 
is designated as the "mpeg-play" program. 

Rg. 69 is a flow diagram which shows the basic 
operation sequence of such a prior art information pro- 
vider apparatus. The operation is as follows: 

Step 1 

The home page (i.e. the base page of hypertext 
data), which is held in the WWW data storage section 
31 of the server computer, is requested by the client ter- 
minal, and is then transferred to the information brows- 
ing section 2, and is displayed to the user by the display 
apparatus 12. 

Step 2 

The system warts to receive an input from the user, 
via the input apparatus 1 1 . 

Step 3 

A decision is made as to whether the user has input 
a command to end operation (in which case operation is 
terminated), or selected a hyperlinked data item, in 
which case: 

Step 4 

The data which are the destination of the hyperlink 
are transferred from the WWW data service section 3, 
and stored in the acquired data storage section 22. The 
data can then be played by the user, through the display 
apparatus 12. 

The sequence of steps 2 through 4 is thereafter 
successively repeated. 

With a prior art type of information provider appara- 
tus which executes the above form of basic operation, 
when each type of WWW data is acquired by the client 
terminal from the server computer, data processing is 
executed by the browsing control section 21 as illus- 
trated by the flow diagram of Fig. 70. The operation is as 
follows: 

Step 11 

A home page acquisition request is generated by 
the information browsing section 2 and is transferred via 
the data communication path 4 to the WWW data serv- 
ice section 3. Hypertext data expressing the home page 
are then read out from the WWW data storage section 
31 of the WWW data service section 3 and transferred 
via the data communication path 4 to the information 
browsing section 2, to be displayed by the display appa- 
ratus 12. 
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Steele 

The input apparatus 1 1 is then used to specify 
either select a hyperiinked data item, or to specify that 
operation is to be ended. 

Step 13 

If termination of operation has been specified in 
step 12, then operation is ended. 

Step!! 

If a hyperiinked item of WWW data has been 
selected in step 12, then the data are acquired by the 
information browsing section 2 from the server compu- 
ter, and stored in the acquired data storage section 22. 

Step 15 

A decision is made as to whether the acquired and 
stored WWW data are hypertext data (in the HTML for- 
mat) or monomedia data. 

Step 16 

tf the acquired data are hypertext data, then the 
page data displayed by the display apparatus 12 are 
updated accordingly. 

Step 17 

If the acquired data are monomedia data, then the 
data are supplied to the display apparatus 12 by the 
monomedia data playing section 23. and operation 
returns to step 12. 

Judgement of the type of WWW data in step 15 is 
based on the playing control table, which has the form 
illustrated in Fig. 68, i.e. with the judgement being 
based on the respective file extensions of the acquired 
data files fi e. considering each page unit of hypertext 
data as a file). ~~ 

Fig. 71 A shows an example of successive configu- 
rations of WWW data which become stored in the 
acquired data storage section 22 of the information 
browsing section 2 of such a prior art information pro- 
vider apparatus, as a result of execution of selection 
operations by a user as described above. Fig. 71 B 
shows an example of initial setting information for 
WWW data providing, which is stored in the acquired 
data storage section 22 of that apparatus. In Fig. 71 A, 
33. 34 and 35 denote respective pages of hypertext 
data which are provided as WWW data, while 36 to 39 
denote respective files of monomedia data which are 
similarly provided. As shown, the home page contains 
hyperlinks to the hypertext pages which are named 
pics.html and movs.html. The page which is named 
pics.html, for example, contains hyperlinks to two still 
picture data files, which are named pid .gif and pic2.gif 



respectively. 

In Fig. 71 B, the single-record table 40 shows the 
format under which the home page data are managed, 
i.e. using the file name "home.htmr. 
; An example of the operation of such a prior art 

information provider apparatus will be described in the 
following, for the case of the WWW data configuration 
example of Figs. 71 A and 71 B, referring to Fig. 72. Fig. 
72 shows examples of actual display screen contents 
w which correspond to the contents of the hypertext data 
and monomedia data shown in Figs. 71 A, 71 B. Firstly, 
when operation is started, the display screen of the dis- 
play apparatus 12 will be of the form indicated by 41 in 
Fig. 72, with the home page 41a being displayed. The 
is item selection regions are assumed to be indicated by 
underlining the corresponding parts of the displayed 
text In that condition, the user can select hyperlinks to 
either a set of still picture items, or to a set of video 
items. If the user selects the set of still picture items, for 
20 example by "clicking" a switch of a mouse, after having 
moved the display cursor to "still picture set" region of 
the display screen, then the display will be updated as 
indicated numeral 42. with the "still picture set " P a 9 e 
42a being displayed. In that condition, if the user now 
25 selects the "sample 1" region, then a "still picture dis- 
play" application program will be invoked, and the "sam- 
ple 1" still picture will be displayed. The resultant display 
screen will be as indicated by numeral 43, with the still 
picture 43a being displayed, but with the "still picture 
30 set" page 42a continuing to be displayed in the back- 
ground. In addition, a specific region 43c of the display 
screen 43 will be delineated, which can be selected by 
the user (as described for the item selection regions) 
when it is desired, to terminate the still picture display. 
35 Such a selectable control region 43a of a display is often 
referred to as a "button". 

Similarly, if the user selects the Video set" from the 
home page 41a at display screen 41, then the display 
screen designated by numeral 44 will be produced, with 
40 the "video set" page 44a being displayed- In that condi- 
tion, if for example the "sample 1 " item is selected by the 
user, then a Video display" application program will be 
invoked, whereby the data of the video data file corre- 
sponding to "sample 1" will begin to be played on an 
45 updated display screen 45, as indicated by numeral 
45a. In addition, respective buttons or icons which can 
be selected by the user to control playing of the video 
(including a "terminate pteying" button) are also dis- 
played, as indicated by numeral 45c. The "video set" 
50 page 44a continues to be displayed, in the background. 
In addition to using hyperlinks to shift between dif- 
ferent hypertext data pages, is possible to use alterna- 
tive methods, for example whereby a user can move to 
an immediately preceding page (i.e. a page which the 
55 user had previously selected). Such operation can be 
based on maintaining a history of pages which have 
been successively selected by the user, and utilizing 
that history for reference purposes. 

In that way, WWW data can be managed in a man- 
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ner that is based upon hypertext data, i.e. whereby 
hyperlinks are embedded in each page of hypertext 
data, pointing to other page units of the hypertext data 
or to monornedia data files. When the user performs a 
hyperlink selection operation, the designated data are 5 
acquired from the WWW data service section 3 via the 
data communication path 4, using the HTTP communi- 
cation system 41, and then are handled in accordance 
with the type of data. For example if an acquired data 
file has the file name extension ".mpeg", it will be judged w 
that the contents are video data. The appropriate pro- 
gram is, thereby invoked to play the data. 

The various sections of such a prior art type of 
information provider apparatus typically use the follow- 
ing types of hardware and software: 15 

I/O section 1: The input apparatus 11 generally 
includes a pointing device such as a mouse, as men- 
tioned above, while the display apparatus 12 generally 
includes a bit-mapped type of display device. 

Information browsing section 2: The browsing con- 20 
trol section 21 may use a WWW data display program 
such as the NCSA Mosaic (a registered trademark of 
NCSA, which is the National Center for Super Comput- 
ing Applications, University of Illinois, U.S.A), or Net- 
scape (a registered trademark of Netscape 25 
Communications Co.. U.S.A). The monornedia data 
playing section 23 may use the "mpeg-play" program for 
displaying video data in the MPEG format, and the "xv" 
program for displaying still picture data in the GIF 
(Graphics Interchange Format). 30 

WWW data service section 3: The WWW data 
management section 32 may use the daemon process 
w httpd*'(a registered trademark of the aforementioned 
NCSA, and of CERN, the European Particie Physics 
Laboratory). 35 

Data communication path 4: The HTTP communi- 
cation system 41 may use the aforementioned HTTP 
communication protocol. 

With such a prior art type of information provider 
apparatus, the data which are managed consist of 40 
either hypertext data or monornedia data. As described 
above, data (i.e. hypertext page data or monornedia file 
data) which are selected by a user, by utilizing the 
hyperlinks, are downloaded to the client terminal by uti- 
lizing a suitable hypertext data communication protocol, 45 
and and can then be played, with the previous hypertext 
page (i.e. from which the currently played data were 
linked) remaining at least partially visible in the display. 

With improvements which have been achieved in 
monornedia data processing capabilities in recent so 
years, it has become possible to easily manage large 
amount&of multimedia data, i.e. a complex combination 
of text, video, still picture (graphics) and audio data. 
Multimedia data are widely used for example to imple- 
ment multimedia display "presentations" for commercial 55 
or other purposes, whereby text, video, graphic and 
audio information concerning a theme such as a com- 
mercial product, for example, are simultaneously pre- 
sented. There is a need for an information provider 



apparatus whereby users of client terminals can easily 
and rapidly select from various sets of data, e.g. data 
which are held stored at a server computer, which will 
result in playing of respectively different sets of multime- 
dia data, i.e. each set constituting a multimedia presen- 
tation formed of various types of media data which are 
played for respectively predetermined durations, and 
with attributes such as display screen position and pic- 
ture size of video clips, still pictures and text portions 
which are components of the clip also being respec- 
tively predetermined. That would preferably be accom- 
plished by means of a new type of information provider 
apparatus, whereby it would become possible to select 
desired multimedia data sets by using hyperlinks which 
are embedded in hypertext data pages as described 
above. That would provide the advantage of conven- 
ience to the user, since a user need only select a hyper- 
text data page and the "click" on the appropriate 
hyperlink position, to start playing a desired multimedia 
clip, in same way as has been used for moving through 
a succession of hypertext data pages, or for download- 
ing a monornedia data file from a hypertext data page. 

However if it were attempted to use prior art types 
of information provider apparatus to achieve such a 
function, various problems would arise. Firstly, as 
described hereinabove referring to the example of Fig. 
66 which utilizes the HTTP communication protocol, 
when such a prior art type of information provider appa- 
ratus acquires a specific monornedia data file, such as a 
file of video data, the data are first read out from the 
WWW data storage section 31 of the WWW data serv- 
ice section 3 in the server computer, are transferred to 
the information browsing section 2 of the client terminal, 
and are then stored in the acquired data storage section 
22 of the information browsing section 2. Until all of the 
monornedia data file have been stored in the acquired 
data storage section 22, playing of the monornedia data 
contents cannot begin. Since multimedia data is a com- 
bination of various types of monornedia data; before 
playing a specific set of multimedia data, it would be 
necessary to first download into the acquired data stor- 
age section 22 each of the monornedia data files which 
are to be components of the multimedia data set, therr 
download information (referred to in the following as 
scenario information) which specifies the various afore- 
mentioned attributes which are to be assigned for play- 
ing each of the components of the multimedia data. 
Thus, a substantial time would elapse between the point 
at which a user selects playing of a specific clip of mul- 
timedia data, and the time at which playing of the multi- 
media data actually begins. 

Such a time lag problem also exists, of course, 
when monornedia data such as a still picture data file is 
downloaded from a hyperlink of a hypertext page. One 
attempt to reduce this problem, with respect to still pic- 
ture (graphics) data, is provided by the Netscape 
browser program (developed by Netscape Communica- 
tions Co., U.S.A.) for WWW data communication. When 
that program is utilized by a client terminal, it becomes 
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possible to begin displaying the contents of a still picture 
while the picture data are in the process of being down- 
loaded by the client terminal. However in the case of 
video data, it is still necessary to store all of the contents 
of a video data file beforehand at the client terminal, s 
before playing of the data can begin. 

There is therefore a requirement for an information 
provider apparatus whereby a user can easily select 
multimedia data to be played, from among a plurality of 
different sets of multimedia data, i.e. different multime- 10 
dia data clips, and whereby there is no substantial time 
lag between the point at which such a selection opera- 
tion is performed by the user and the point at which 
playing of the selected multimedia data begins. 

15 

SUMMARY OF THE IN VENTION 

It is an objective of the present invention is to over- 
come the disadvantages of the prior art described 
above, by providing an information provider apparatus 20 
whereby a user can employ hyperlink selection from a 
displayed page of hypertext data to select a set of multi- 
media data to be played, with that set being selected 
from among various predetermined sets of multimedia 
data which are held stored in a data storage device 2s 
which may be stored for example at a server computer 
of a client/server network 

tt is a further objective of the invention to provide 
such an information provider apparatus, configured 
such that even if the selected data are stored at a 30 
remote installation playing of the selected data can be 
rapidly started in response to a user designation, by 
directly transferring the selected data from the remote 
installation and playing the data as they are received. 

It is a further objective of the invention to provide 35 
such an information provider apparatus, conf igured as a 
client/server network having a plurality of client termi- 
nals which are respectively operable by users, and at 
least one server computer, whereby the multimedia 
data can be held stored in a data storage device of the 40 
server computer and whereby each user of a client ter- 
minal can access and play the data independently of 
other users. 

It is moreover an objective of the invention to pro- 
vide such an information provider apparatus, configured 45 
as a client/server network having a plurality of client ter- 
minals which are respectively operable by users, and at 
least one server computer, whereby the users of client 
terminals may generate and exchange hypervideo mail 
items, each consisting of a set of multimedia data in so 
combination with corresponding scenario data. 

An information provider apparatus according to the 
present invention operates on multimedia data in a form 
which will be refened to in the following as hypervideo 
data, with respective separately managed sets of hyper- ss 
video data being referred to as hypervideo clips. With 
the present invention, the data constituting a hypervideo 
clip consists of: 



(a) A plurality of files of subject matter data, which 
express the monomedia data contents of the hyper- 
video data. These files include a file for at least one 
video clip, which is used as a reference video dip. 
Successive frame numbers of the reference video 
clip are used to synchronize the playing of other 
monomedia data items (such as other video clips, 
audio clips, still pictures, text documents, etc.) of 
the hypervideo clip, during playing of the hyper- 
video clip. 

(b) A file of scenario data, containing information 
expressing respective storage locations of the sub- 
ject matter data fBes, and also information which 
expresses respective playing attributes for the sub- 
ject matter data files, e.g. times at which the con- 
tents of the various files are to begin to be played 
(expressed in terms of elapsed frame numbers of 
the aforementioned reference video clip), and the 
position and size of the display screen region in 
which visual data items are to be displayed, etc. 
The subject matter data storage location informa- 
tion may simply consist of a list of the respective 
subject matter data file names, in some cases. 

According to a first aspect, such an information pro- 
vider apparatus comprises: 

a data input/output section including data input 
means operable by a user for inputting operating 
commands, and data display means for displaying a 
plurality of types of monomedia data including at 
least video data and text data, the operating com- 
mands being generated by hyperlink selection in 
accordance with a page of hypertext data which is 
currently being displayed by the data display 
means; 

data storage means for storing hypertext data and 
data of at least one hypervideo clip, the hypervideo 
dip data being formed of subject matter data and 
scenario data, the subject matter data comprising 
data of a plurality of monomedia data hems which 
include a video clip that has been preassigned as a 
reference video clip of the hypervideo clip, the sce- 
nario data including information specifying times of 
starting playing of respective ones of the monome- 
dia data items other than the reference video clip, 
the starting times bang specified in terms of frame 
numbers of the reference video clip; 
means responsive to the operating commands for 
reading out, from the data storage means, the sce- 
nario data and subject matter data of a hypervideo 
clip which is specified by the operating commands; 
and 

means for continuously supplying the reference 
video data of the specified hypervideo clip to the 
data data display means to be displayed thereby, as 
the reference video data are read out from the data 
storage means, and for maintaining a count of 
elapsed frame numbers of the reference video clip, 
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selectively generating data transfer commands to 
acquire from the data storage means specific sub- 
ject matter data of the specified hypervideo clip 
other than the reference video dip. at times deter- 
mined in accordance with the the count of frame 5 
numbers in conjunction with the scenario data, and 
- continuously supplying the specific subject matter 
data to the data display means as the specific sub- 
ject matter data are read out from the data storage 
means, with video data of the subject matter data 10 
being transferred to the data display means at a 
transmission rate which permits real-time transfer 
and continuous-motion display of the contents of 
the video data. 

15 

According to a second aspect such an information 
provider apparatus comprises: 

a first data service section including first data stor- 
age, means having stored therein hypertext page 20 
data and monomedia data, the monomedia data 
including scenario reference data corresponding to 
respective hypervideo clips, the scenario reference 
data being connected by hyperlinks to the hypertext 
page data, the scenario reference data including 25 
storage location information for respective scenario 
data files of the hypervideo clips within second data 
storage means, the first data service section being 
responsive to externally supplied first data transfer 
commands for selectively reading out the hypertext 30 
page data and scenario reference data; 
a second data service section, including the second 
data storage means having stored therein data con- 
stituting the hypervideo clips, responsive to second 
data transfer commands for selectively reading out 35 
the data, the data of a hypervideo clip consisting of 
a scenario data file and a plurality of subject matter 
data files for respective monomedia data items, the 
monomedia data items including a video clip which 
has been preassigned as a reference video clip, the 40 
scenario data including storage location information 
for the subject matter data files-with respect to the 
second data storage means and playing informa- 
tion including times of starting playing the contents 
of respective ones of the subject matter data files 45 
other than the reference video clip, the starting 
times being specified in terms of frame numbers of 
the reference video clip; 

a data input/output section including input means 
operable by a user for inputting operating com- so 
mands and data display means for playing a plural- 
ity of types of monomedia data including at least 
video data and text data, the operating commands 
being generated by hyperlink selection from a page 
of hypertext data which is currently being displayed 55 
by the data display means; 

information browsing means comprising informa- 
tion browsing control means, acquired data storage 
means and hypervideo data playing means, 



the information browsing control means being 
responsive to the operating commands for generat- 
ing corresponding ones of the first data transfer 
commands to thereby acquire, from the first data 
service section, data of a specific one of the hyper- 
text pages or scenario reference data for a specific 
one of the hypervideo clips, 
the acquired data storage means storing the 
acquired hypertext page data and scenario refer- 
ence data, with the hypertext page data being read 
out and supplied to the data display means, and 
the hypervideo data playing means reading out the 
scenario reference data from the acquired data 
storage means and using the scenario reference 
data to generate the second data transfer com- 
mands for thereby obtaining the scenario data of 
the specific hypervideo clip from the second data 
service section, using the scenario data to further 
generate the second data transfer commands for 
thereby obtaining the reference video clip data of 
the specific hypervideo dip from the second data 
service section and continuously supplying the ref- 
erence video dip data to the data display means, 
maintaining a count of elapsed frame numbers of 
the reference video clip, further generating the sec- 
ond data transfer commands to begin obtaining 
from the second data service section the contents 
of specific subject matter data files of the hyper- 
video dip at respective times determined in accord- 
ance with the the count of frame numbers in 
conjunction with the scenario data, and continu- 
ously supplying the contents to the data display 
means; and 

first data transfer means for transferring the first 
data transfer commands from the information 
browsing control means to the first data service 
section and for transferring resultant hypertext page 
data and scenario reference data to be stored in the 
acquired data storage means, and second data 
transfer means for transferring the second data 
transfer commands from the hypervideo data play- 
ing means to the second data service section and 
for transferring resultant scenario data and subject 
matter data to the hypervideo data playing means, 
the second data transfer means executing the data 
transfer at a transmission rate permitting real-time 
transfer with continuous-motion display of the con- 
tents of video data portions of the subject matter 
data. . 

According to a third aspect, such an information 
provider apparatus comprises: 

a first data service section induding first data stor- 
age means having stored therein hypertext page 
data and monomedia data, the monomedia data 
including scenario reference data corresponding to 
respective hypervideo clips, the scenario reference 
data being connected by hyperlinks to the hypertext 
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page data, the scenario reference data including 
storage location information for respective scenario 
data files of the hypervideo clips within second data 
storage means, the first data service section being 
responsive to externally supplied first data transfer 5 
commands for selectively reading out the hypertext 
page data and scenario reference data; 
a second data service section, including the second 
data storage means having stored therein data con- 
stituting the hypervideo clips, responsive to second 10 
data transfer commands for selectively reading out 
the data, the data of a hypervideo clip consisting of 
a scenario data file and a plurality of subject matter 
data files for respective monomedia data items, the 
monomedia data items including a video dip which 15 
has been preassigned as a reference video clip, the 
scenario data including storage location information 
for the subject matter data files with respect to the 
second data storage means and playing informa- 
tion including times of starting playing the contents 20 
of respective ones of the subject matter data files 
other than the reference video clip, the starting 
times being specified in terms of frame numbers of 
the reference video clip; 

a data input/output section including input means 25 
operable by a user for inputting operating com- 
mands and data display means for playing a plural- 
ity of types of monomedia data including at least 
video data and text data, the operating commands 
being generated by hyperlink selection from a page 30 
of hypertext data which is currently being displayed 
by the data display means; 

information browsing means comprising informa- 
tion browsing control means, acquired data storage 
means and hypervideo data playing means, 35 
the information browsing control means being 
responsive to the operating commands for generat- 
ing corresponding ones of the first data transfer 
commands to thereby acquire, from the first data 
service section, data of a specific one of the hyper- 40 
text pages or scenario reference data for a specific 
one of the hypervideo clips, ~ 
the acquired data storage means storing the 
acquired hypertext page data and scenario refer- 
ence data, with the hypertext page data being read 45 
out and supplied to the data display means, and 
the hypervideo data playing means reading out the 
scenario reference data from the acquired data 
storage means and using the scenario reference 
data to generate the second data transfer com- so 
mands for thereby obtaining the scenario data of 
the specific hypervideo clip from the second data 
service section, using the scenario data to further 
generate the second data transfer commands for 
thereby obtaining the reference video clip data of 55 
the specific hypervideo dip from the second data 
service section and continuously supplying the ref- 
erence video dip data to the data display means, 
maintaining a count of elapsed frame numbers of 



the reference video dip, further generating the sec- 
ond data transfer commands to begin obtaining 
from the second data service section the contents 
of specific subject matter date files of the hyper- 
video dip at respective times determined in accord- 
ance with the the count of frame numbers in 
conjunction with the scenario data, and continu- 
ously supplying the contents to the data display 
means; and 

first data transfer means for transferring the first 
data transfer commands from the information 
browsing control means to the first data service 
section and for transferring resultant hypertext page 
data and scenario reference data to be stored in the 
acquired data storage means, and second data 
transfer means for transferring the second data 
transfer commands from the hypervideo data play- 
ing means to the second data service section and 
for transferring resultant scenario data and subject 
matter data to the hypervideo data playing means, 
the second data transfer means executing the data 
transfer at a transmission rate permitting real-time 
transfer with continuous-motion display of the con- 
tents of video data portions of the subject matter 
data. 

With such an information provider apparatus, the 
data input/output section and information browsing 
means in combination can constitute a dient terminal, 
and the first data service section and second data serv- 
ice section in combination can constitute a server com- 
puter for providing hypertext data and hypervideo data 
to the dient terminal, with the dient terminal and server 
computer being mutually connected by the data com- 
munication path. 

In particular, the apparatus can be configured in the 
form of a network, i.e. comprising a plurality of the dient 
terminals, each connected to the server computer by 
the data communication path for mutually independently 
communicating with the server computer, the data com- 
munication path being configured as a network data 
communication path. 

Furthermore, such an information provider appara- 
tus can be configured for providing hypervideo maH in a 
similar manner to providing conventional electronic 
mail. According to a fourth aspect, such an information 
provider apparatus comprises: 

hypervideo mail processing means for processing 
hypervideo mail items each consisting of a hyper- 
video clip in combination with at least mail destina- 
tion information, the hypertext data in the data 
storage means further including hypervideo mail 
page data containing, for each of respective hyper- 
video mail Hems received by the hypervideo mail 
processing means, the mail destination information 
in conjunction with a hyperlink to the scenario refer- 
ence data file of the mail item, the hypervideo mail 
processing means comprising: 
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temporary mail storage means, 
mail processing means for receiving externally sup- 
plied hypervideo mail items, extracting the destina- 
tion information from an externally supplied 
hypervideo mail item, transferring the subject mat- 5 
ter data and scenario data contents of the hyper- 
* video mail item to the second data service section 
to be stored in the second data storage means, and 
transferring resultant storage location information 
for the subject matter data and scenario data, in 10 
conjunction with the mail destination information, to 
thefirst data service section for thereby generating 
a scenario reference file for the mail item and 
updating the hypervideo mail page data. 

15 

in general, the hypervideo mail generating means, 
the data input/output section and the information brows- 
ing means, in combination, will constitute a client termi- 
nal, and the hypervideo mail processing means, first 
data service section and second data service section, in 20 
combination, will constitute a mail server computer, the 
client terminal and mail server computer being mutually 
connected by the data communication path. 

Such an apparatus can also be configured as a net- 
work, i.e. comprising a plurality of the client terminals , 25 
each connected to the mail server computer by the data 
communication path for mutually independently com- 
municating with the mail server computer, with the data 
communication path being configured as a network data 
communication path. 30 

Furthermore, the apparatus can be configured as a 
plurality of such networks, i.e. local area networks, 
which mutually communicate via an inter-network data 
communication path, wherein the mail server computer 
of a local area network executes dedicated storage of 35 
data of hypervideo mail items having as destinations 
any of the client terminals of the local area network, 
wherein each of the mail server computers further com- 
prises destination enquiry management means for pro- 
viding information specifying respective hypervideo mail 40 
item storage dedication relationships between the mail 
server computers and client terminals, and wherein an 
originating client terminal functions, prior to sending a 
hypervideo mail item to a destination client terminal, to 
obtain from the destination management means of the 45 
mail server computer of the originating client terminal, 
the identity of the dedicated mail server computer of the 
destination client terminal, and to then transmit the 
hypervideo mail item to the dedicated mail server com- 
puter. 50 

An information provider apparatus according to the 
present invention can further be configured to enable 
hypervideo messages to be "posted" on an electronic 
"notice board", to be made accessible to various users. 
Each hypervideo message is based on a hypervideo 55 
clip (i.e. a combination of scenario data and multimedia 
data including a reference video clip) in conjunction with 
the name of a notice board on which the message is to 
be posted, and information such as a. message title or 



"message theme" indicative of the nature of the mes- 
sage. Each notice board consists of a predetermined 
hypertext page. 

Such an information provider apparatus can be 
configured as a wide-area nework, formed of a plurality 
of client/server local area networks, in which hypervideo 
messages which are posted to a specific notice board 
within one local area network e.g. by being sent by a 
user of a client terminal of that network to the server 
computer of that network, are automatically distributed 
to each of a predetermined set of other local area net- 
works, to be posted on a corresponding notice board in 
each of these other local area networks. 

Specifically, with such an information provider 
apparatus, the hypertext page data include data of at 
least one page which is assigned as a notice board, the 
apparatus further comprising hypervideo message 
posting processing means for receiving externally sup- 
plied hypvervideo messages each formed of scenario 
data and subject matter data of a hypervideo clip in con- 
junction with information specifying a message theme 
and a name of a notice board page, each of the 
hypvervideo messages being configured in a predeter- 
mined format, the hypvervideo message posting 
processing means including: 

hypervideo message data distribution means for 
supplying the subject matter data data and sce- 
nario data of a hypervideo message to the second 
data service means to be stored as scenario data 
and subject matter data files in the second data 
storage means and obtaining from the second data 
service means storage locating information for the 
message data contents, and 
notice board page updating processing means for 
receiving from the hypervideo message data distri- 
bution means the notice board name information, 
message theme information and storage location 
information for the hypervideo message data con- 
tents, and for supplying the storage location infor- 
mation and message theme information to the first 
data service means to thereby update a notice 
board page which is specified by the notice board 
name information, by inserting the message theme 
information into the notice board page with the 
message theme information having a hyperlink 
connection to the scenario data and subject matter 
data files. 

With such an information provider apparatus the 
hypervideo mail generating means data inpuVoutput 
means and information browsing means in combination 
may constitute a client terminal, and the hypervideo 
mail processing means, first data service means, sec- 
ond data service means and hypervideo message post- 
ing processing means in combination may constitute a 
server computer, with the client terminal and server 
computer being mutually connected by the data com- 
munication path, and the apparatus may comprise a 
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plurality of the client terminals each connected to the 
server computer by the data communication path for 
mutually independently communicating with the server 
computer, with at least one of the client terminals com- 
prising hypvervideo message generating means con- 
trollable for generating arbitrary hypvervideo messages 
and sending the hypvervideo messages to the server 
computer via the data communication path to the local 
area network, the data communication path being con- 
figured as a network data communication path, 

Such an information provider apparatus may more- 
over comprise a wide-area network having a plurality of 
local area networks, each comprising a plurality of the 
client terminals and a server computer mutually con- 
nected by a network data communication path, and an 
inter-network data communication path interconnecting 
respective server computers of the local area networks, 
wherein the client terminals of a local area network 
transmit hypvervideo messages only to the server com- 
puter of the local area network, each of the server com- 
puters further including wide-area distribution 
processing means, the wide-area distribution process- 
ing means comprising: 

means responsive to posting of a hypervideo mes- 
sage by the server computer for distributing the 
hypervideo message, via the inter-server data com- 
munication path to each of a predetermined set of 
other server computers of the wide-area network, 
and 

means responsive to receiving, via the inter-net- 
work data communication path, a distributed hyper- 
video message, for executing processing to post 
the distributed hypervideo message in a notice 
board page which is specified by the notice board 
name information of the hypervideo message. 

The wide-area distribution processing means of a 
server computer may comprise distribution memory 
means having stored therein information specifying, for 
each of respective notice board pages assigned in the 
first data service means of the server computer, respec- 
tive names of other server computers to which are pre- 
determined as distribution destination server computers 
for the notice board page, 

message posting detection means coupled to the 
hypervideo message posting processing means, 
responsive to execution of processing to post a 
hypervideo message by the hypervideo message 
posting processing means for generating detection 
result data corresponding to the hypervideo mes- 
sage, the detection result data specifying at least 
information specifying the message theme of the 
hypervideo message and a name of a notice board 
page on which the hypervideo message was 
posted, 

distribution transmitting means coupled to receive 
the detection result data from the message posting 
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detection means, for obtaining from the distribution 
condition memory respective names of the distribu- 
tion destination server computers corresponding to 
the notice board page, and for transmitting the 
hypervideo message to each of the distribution des- 
tination server computers, via the inter-server data 
communication path, and 

distributed message data receiving means for 
receiving distributed hypervideo messages trans- 
mitted thereto via the inter-server data communica- 
tion path for configuring each the distributed 
hypervideo message in the predetermined format 
and supplying the distributed hypervideo message 
to the hypervideo message posting processing 
means. 



25 



30 



The distribution transmitting means may comprise 
means for transmitting a hypervideo message to a dis- 
tribution destination server computer via the inter -server 
20 data communication path by: 

creating a header file containing the notice board 
name information and message theme information 
of the hypervideo message, 
obtaining from the second data service means the 
scenario data file and subject matter data files of 
the hypervideo message, 

and transmitting the data contents of each of the 
header file, scenario data file and subject matter 
data files to the distribution destination server com- 
puter via the inter-server data communication path 
by direct data transfer, using a wide-area network 
file transfer protocol (i.e. FTP)- 

35 The distributed message data receiving means 
may comprise means for processing the data of a 
hypervideo message received via the inter-server data 
communication path by obtaining from the header file 
the notice board name information and message theme 
40 information, and combining the notice board name and 
message theme information with the data contents of 
the scenario data file and subject matter data files to 
configure the hypervideo message in the predeter- 
mined format, and supplying a resultant hypervideo 
45 message to the hypervideo message posting process- 
ing means. 

Alternatively, information provider apparatus the 
distribution transmitting means of such an information 
provider apparatus may comprise means for transmit- 
50 ting a hypervideo message by a server computer via the 
inter-network data communication path by: 

obtaining storage position information for the sce- 
nario data and subject matter data files of the 
55 hypervideo message, with respect to the second 
data service means, to generate message updating 
information containing the storage position informa- 
tion together with the notice board name informa- 
tion and message theme information, and 
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transmitting the message updating information via 
the inter-server data communication path to the dis- 
tribution destination server computer. The distrib- 
uted message data receiving means may comprise 
means for processing the message updating infor- 5 
mation of a hypervideo message, received via the 
. inter-server data communication path, by: 

obtaining from the message updating information 
the storage position information which is contained 
therein; 10 
obtaining the data contents of the scenario data file 
and subject matter data files of the hypervideo mes- 
sage by direct data transfer via the inter-server data 
communication path using a wide-area network file 
transfer protocol (FTP), from a server computer is 
which originated the message updating informa- 
tion, 

obtaining, from the message updating information, 
the notice board name information and message 
theme information which are contained therein, and 20 
combining the notice board name and message 
theme information with the data contents of the sce- 
nario data file and subject matter data files to con- 
figure the hypervideo message in the 
predetermined format, and supplying a resultant 25 
hypervideo message to the hypervideo message 
posting processing means. 

In that case, each of the server computers may 
comprise temporary data storage means (i.e. such as a 30 
mail spool, for received electronic mail items) which can 
be used to temporarily hold the message updating infor- 
mation; when the message updating information are 
received via the inter-server data communication path. 
In general, the means for processing the message 35 
updating information by the distributed message data 
receiving means will perform the processing by execut- 
ing a specific program, and so the each server compu- 
ter may further comprise scheduling memory means for 
storing schedule data which specify scheduled times of 40 
execution of at least the specif ic program, and schedul- 
ing execution means coupled to the distributed mes- 
sage data receiving means, for controlling the 
distributed message data receiving means to initiate the 
processing of message updating information which is 45 
held in the temporary data storage means, at a time 
determined by the schedule data. 

Alternatively, with such an information provider 
apparatus the distribution transmitting means may com- 
prise means for encoding the hypervideo message cor- 50 
responding to the detection result data, to obtain an 
encoded hypervideo message having the form of an 
electronic mail item, by creating a header file containing 
the notice board name and message theme information 
from the detection result data, and encoding the header 55 
file together with the scenario data and subject matter 
data files of the hypervideo message corresponding to 
the detection result data, and means for transmitting the 
encoded hypervideo message to each of the distribution 



destination server computers via the inter-server data 
communication path by using an electronic mail transfer 
communication protocol which is designed for transfer 
of electronic mail items within a wide-area network. In 
that case, the distributed message data receiving 
means will comprise means for decoding an encoded 
hypervideo message which is received via the inter-net- 
work data communication path to obtain the header file, 
scenario data file and subject matter data files, for con- 
figuring the data of the header file, scenario data file 
and subject matter data files in the predetermined 
hypervideo message format, and supplying a resultant 
hypervideo message to the hypervideo message post- 
ing processing means. 

Such encoding of the data of a hypervideo mes- 
sage in the form of an electronic mail item is preferably 
executed by using Multi-purpose Internet Mail Exten- 
sions (MIME) encoding, and the electronic mail transfer 
communication protocol is preferably the Simple Mail 
Transfer Protocol (SMTP), which are widely used at 
present with the Internet. Such a manner of transferring 
a hypervideo message within a wide-area network can 
enable reliable (although relatively slow-speed) mes- 
sage transfer to be achieved, even via a network com- 
munication path which does not satisfy the necessary 
conditions for implementing high-speed direct transfer 
of file data using a file transfer protocol (FTP). 

As a further alternative, with such an information 
provider apparatus the distribution transmitting means 
may be formed of a 1 st distribution transmitting means 
and a 2nd distribution transmitting means, and the dis- 
tributed message data receiving means may be formed 
of a 1st distributed message data receiving means and 
a 2nd distributed message data receiving means. The 
1 st distribution transmitting means comprises means for 
obtaining storage position information for the scenario 
data and subject matter data files of the hypervideo 
message, with respect to the second data service 
means, to generate message updating information con- 
taining the storage position information together with 
the notice board name information and message theme 
information which are conveyed by the detection result 
data, and means for transmitting the message updating 
information via the inter-server data communication 
path to each the distribution destination server compu- 
ter. The 1st distributed message data receiving means 
comprises means for processing the message updating 
information of a hypervideo message, received via the 
inter-server data communication path, by obtaining from 
the message updating information the storage position 
information which is contained therein, obtaining the 
data contents of the scenario data file and subject mat- 
ter data files of the hypervideo message by direct data 
transfer via the inter-server data communication path 
from a server computer which originated the message 
updating information, using a wide-area network file 
transfer protocol (FTP), configuring the notice board 
name information and message theme information from 
the message updating information together with the 
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contents of the scenario data file and subject matter 
data files in the predetermined format, and supplying a 
resultant hypervideo message to the hypervideo mes- 
sage posting processing means, and comprising 
means, functioning in the event of a failure to obtain the 5 
data contents of the scenario data file and subject mat- 
ter data files of the hypervideo message by direct data 
transfer, for sending to the originating server computer 
via the inter-server data communication path a request 
for retransmission of the hypervideo message, encoded w 
in the form of an electronic mail item. The 2nd distribu- 
tion transmitting means comprises means functioning in 
response to receiving via the inter-server data commu- 
nication path a request for retransmission of a hyper- 
video message which has been transmitted by the 1st 75 
distribution transmitting means, for creating a header 
file containing the notice board name and message 
theme information from the detection result data of the 
hypervideo message, encoding the header file together 
with the scenario data and subject matter data files of 20 
the hypervideo message, as an encoded hypervideo 
message in the form of an electronic mail item, and 
transmitting the encoded hypervideo message via the 
inter-server data communication path using an elec- 
tronic mail transfer communication protocol which is 25 
designed for transfer of electronic mail items within a 
wide-area network, to a distribution destination server 
computer which originated the request for retransmis- 
sion. The 2nd distributed message data receiving 
means comprises means for decoding an encoded 30 
hypervideo message which is received via the inter-net- 
work data communication path, to obtain the header file, 
scenario data file and subject matter data files, for con- 
figuring the data of the header file, scenario data file 
and subject matter data files in the predetermined for- 35 
mat, and supplying a resultant hypervideo message to 
the hypervideo message posting processing means. 
Such an apparatus also includes distributed message 
data input processing means coupled to receive data 
transmitted via the intra-network data communication 40 
path, for notifying the 1st distributed message data 
receiving means when the received data consist of 
message updating information and for supplying the 
message updating information to the 1st distributed 
message data receiving means, for notifying the 2nd 45 
distributed message data receiving means when the 
received data consist of a distributed hypervideo mes- 
sage encoded as an electronic mail item and for supply- 
ing the encoded hypervideo message to the 2nd 
distributed message data receiving means, and for noti- 50 
tying the 2nd distribution transmitting means when the 
received data consist of a request for retransmission of 
a hypervideo message and for supplying the request to 
the 2nd distribution transmitting means. 

In that case, H becomes possible to implement 55 
high-speed message transfer between server comput- 
ers of a wide-area network by using direct transfer of 
message data, i.e. employing a file transfer protocol 
(FTP), when such data transfer is possible, and to auto- 



matically change to transferring message data in the 
form of electronic mail (e.g. using the SMTP) when data 
transfer by FTP is impossible, such as when a firewall" 
protection feature is in effect within the data communi- 
cation path between two server computers. 

It can thus be understood that an information pro- 
vider apparatus according to the present invention basi- 
cally enables a user to specify playing of desired 
hypervideo data in a similar manner to the conventional 
"browsing" method of specifying playing of desired mon- 
omedia data. That is to say, selection control by a user 
is based upon hyperlink selection from a displayed page 
of hypertext data, with suitable hypervideo data playing 
means being automatically invoked to play the contents 
of the hypervideo data which are acquired in response 
to such user selection. 

It can be further understood that the invention pro- 
vides an information provider apparatus whereby data 
of a scenario file which contains information expressing 
storage locations in the server computer of respective 
subject matter data files of selected hypervideo data, 
and which is stored at the server computer, are trans- 
ferred from the server computer to the client terminal by 
using a suitable communication system, i.e. based on 
the HTP (Hypertext Transfer Protocol), which is suitable 
for transfer of data expressed in HTML (Hypertext 
Markup Language), and whereby contents of the sub- 
ject matter data files can be transferred from the server 
computer to the client terminal by using communication 
software means such as the Network File System which 
enables direct simultaneous accessing by the client ter- 
minal of a plurality of subject matter data files which are 
stored at the server computer, for thereby enabling 
hypervideo data to be played while the subject matter 
data of the hypervideo data are in the process of being 
transferred from the server computer to the client termi- 
nal. 

As a result, the amount of time which must elapse 
between the point at which a user of a client terminal 
selects specific hypervideo data, and the point at which 
playing of the selected hypervideo data begins, can be 
made substantially shorter than would be possible with 
a prior art type of apparatus. 

It can be further understood that the invention may 
be implemented as an information provider apparatus 
whereby the scenario data of hypervideo data can be 
linked directly to hypertext data which can be accessed 
by a user, so that it is not necessary to provide refer- 
ence information for the scenario data. This can 
decrease the data storage requirements of the informa- 
tion provider apparatus. 

Alternatively, the invention can be implemented as 
an information provider apparatus whereby a specific 
set of hypervideo data consisting of a scenario data file 
and subject matter data files can be managed collec- 
tively as a single file set, which can be connected by 
hyperlink to a hypertext data page. In that case, it 
becomes possible to use only a low-speed data commu- 
nication system for transferring the hypervideo data 
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from a server computer to a client terminal. 

The invention can also be implemented as an infor- 
mation provider apparatus whereby hypervideo data 
and WWW data can be stored at a single server compu- 
ter which is connected via a network to a plurality of cli- s 
ent terminals, with each of the client terminals being 
enabled to play the hypervideo data. 

Alternatively, the invention can be implemented as 
an information provider apparatus in the form of a net- 
work having a server computer and a plurality of client w 
terminals, whereby each of the client terminals, in addi- 
tion to being able to play hypervideo data which is man- 
aged by a server computer for all of the client terminals 
in common, is also enabled to play hypervideo data 
which are specific to that client terminal. 75 

It can be further understood that the invention can 
be implemented as an information provider apparatus 
whereby hypervideo mail items, i.e. electronic mail 
items each based on a hypervideo clip, can be 
exchanged between client terminals, in a network hav- 20 
ing a server computer and a plurality of client terminals, 
or within a wide-area network formed of a plurality of 
local area networks. 

Similarly the invention enables hypervideo mes- 
sages, each based on a hypervideo clip, to be "posted" 25 
on an electronic "notice board" and so made available to 
all of the users of a local area network, or to all of the 
users of a a wide-area network formed of a plurality of 
local area networks, or to users of specific local area 
networks of such a wide-area network. 30 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a conceptual diagram for describing the 
basic principles of playing hypervideo data by an 35 
apparatus according to the present invention; 
Fig. 2 is a system block diagram of a first embodi- 
ment of an information provider apparatus accord- 
ing to the present invention; 

Fig. 3 is a diagram for illustrating how respective 40 

types of data are stored and utilized, for the first 

embodiment; — 

Fig. 4 shows an example of a playing control table 

which is stored in an information browsing section 

of the first embodiment; 45 

Fig. 5 is a flow diagram showing an operation 

sequence which is executed by a browsing control 

section of the first embodiment; 

Fig. 6 is a flow diagram showing an operation 

sequence which is executed by a hypervideo data so 

playing section of the first embodiment; 

Fig. 7 is a conceptual diagram showing examples of 

respective types of data which are stored in a 

WWW data storage section of the first embodiment; 

Fig. 8 is a conceptual diagram for illustrating hyper- 55 

video data which are stored in a hypervideo data 

storage section of the first embodiment; 

Fig. 9 is a diagram showing examples of successive 

display pictures which are generated during opera- 



tion of the first embodiment; 

Fig. 10 is a diagram for illustrating how respective 

types of data are stored and utilized, for a second 

embodiment of an information provider apparatus 

according to the present invention; 

Fig. 1 1 shows an example of a playing control table 

which is stored in an information browsing section 

of the second embodiment; 

Fig. 12 is a conceptual diagram showing examples 
of respective types of data which are stored in a 
WWW data storage section of the second embodi- 
ment; 

Fig. 13 is a flow diagram showing an operation 

sequence which is executed by a hypervideo data 

playing section of the second embodiment; 

Fig. 14 is a diagram for illustrating how respective 

types of data are stored and utilized, for a third 

embodiment of an information provider apparatus 

according to the present invention; 

Fig. 15 shows an example of a playing control table 

which is stored in an information browsing section 

of the third embodiment; 

Fig. 16 is a conceptual diagram showing examples 
of respective types of data which are stored in a 
WWW data storage section of the first embodiment; 
Fig. 17 is a flow diagram showing an operation 
sequence which is executed by a hypervideo data 
playing section of the first embodiment; 
Fig. 18 is a system block diagram showing the basic 
configuration of a fourth embodiment of an informa- 
tion provider apparatus according to the present 
invention, which is configured as a network; 
Fig. 19 is a conceptual block diagram for illustrating 
effective connection relationships between respec- 
tive client terminals and a server computer, with the 
fourth embodiment; 

Fig. 20 is a system block diagram showing the basic 
configuration of a fifth embodiment of an informa- 
tion provider apparatus according to the present 
invention, which is configured as a network, having 
respective dedicated server computers for WWW 
data and hypervideo data; 

Fig. 21 is a system block diagram showing the basic 
configuration of a sixth embodiment of the inven- 
tion, which is configured as a network, having a pair 
of dedicated server computers, respectively for 
WWW data and hypervideo data which are of dis- 
continuous type such as text data, and for hyper- 
video data which are of continuous type, such as 
video data; 

Fig. 22 is a system block diagram showing the basic 
configuration of a seventh embodiment of the inven- 
tion, which is configured as a network, having a 
dedicated server computer for WWW data, and 
respective dedicated server computers for a plural- 
ity of different types of hypervideo data; 
Rg. 23 is a system block diagram showing the basic 
configuration of an eighth embodiment of the inven- 
tion, which is configured as a network, having 
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respective WWW data service sections within each 
of the client terminals; 

Fig. 24 is a system block diagram showing the basic 
configuration of a ninth embodiment of the inven- 
tion, which is configured as a network, having s 
respective dedicated hypervideo data service sec- 
tions within each of the client terminals, and a 
server computer having a hypervideo service sec- 
tion which is used in common by the client termi- 
nals; 10 
Fig. 25 is a system block diagram showing the basic 
configuration of a tenth embodiment of the inven- 
tion, which is configured as a network, having 
respective dedicated WWW data service sections 
and hypervideo data service sections within each of is 
the client terminals, and switches for enabling mas- 
ter data to be selectively transferred from a server 
computer and stored in the respective client termi- 
nals; 

Fig. 26 is a system block diagram showing the basic 20 
configuration of an eleventh embodiment of the 
invention, which is configured as a network, 
wherein abstract portions of hypervideo data clips 
are stored in respective client terminals, and com- 
plete hypervideo data are stored in a server compu- 25 
ter; 

Fig. 27A is a system block diagram of a twelfth 
embodiment of the invention, which is an informa- 
tion provider apparatus having a capability for post- 
ing hypervideo messages on a hypertext page 30 
which is utilized as a notice board, and Fig. 276 is 
a system block diagram showing an example of 
implementing the twelfth embodiment in the form of 
a client/server network; 

Fig. 28 is a conceptual diagram for illustrating an 35 
example of the data configuration of a hypervideo 
message, used with the twelfth embodiment; 
Fig. 29 is an operation flow diagram for a hyper- 
video message posting processing section in the 
twelfth embodiment; 40 
Fig. 30 is a conceptual diagram for illustrating 
respective examples of data configurations of 
WWW data and hypervideo data, stored in the 
twelfth embodiment, prior to receiving a certain 
hypervideo message; 45 
Fig. 31 is a diagram corresponding to Fig. 30, 
showing the data configurations after the hyper- 
video message has been received; 
Fig. 32 is a system block diagram of a thirteenth 
embodiment of an information provider apparatus so 
according to the present invention, having a capa- 
bility for processing hypervideo mail items; 
Fig. 33 is a conceptual diagram for illustrating an 
example of the data configuration of a hypervideo 
mail item, used with the thirteenth embodiment; 55 
Fig. 34 is a partial system block diagram of the thir- 
teenth embodiment, configured as a hypervideo 
mail server computer and a plurality of client termi- 
nals connected as a network, for showing the 



respective basic internal configurations of a client 
terminal and the hypervideo mail server computer; 
Fig. 35 is a system block diagram corresponding to 
Fig. 34, for illustrating data flows between the mail 
server computer and the client terminals; 
Fig. 36 is a conceptual diagram for illustrating 
respective examples of data configurations of 
WWW data and hypervideo data, stored in the thir- 
teen embodiment, prior to a certain hypervideo mail 
item being received by a mail server computer, and 
Fig. 37 is a diagram corresponding to Fig. 36, 
showing the respective data configurations after the 
hypervideo mail item has been received; 
Figs. 38 and 39 are flow diagrams for illustrating the 
basic operation sequences which are executed for 
transferring a hypervideo mail item, with the thir- 
teenth embodiment; 

Fig. 40 is a system block diagram shewing the basic 
components of a fourteenth embodiment of the 
invention, which is an information provider appara- 
tus having a hypervideo mail processing capability, 
and which is suitable for being configured as a plu- 
rality of interconnected LANs (local area networks); 
Fig. 41 shows an example of the contents of a mail 
destination information table which is stored in a 
destination enquiry management section of a mail 
server computer, with the fourteenth embodiment; 
Fig. 42 is a partial system block diagram of the four- 
teenth embodiment, showing a hypervideo mail 
server computer and one of a plurality of client ter- 
minals connected thereto, for illustrating the 
respective basic internal configurations of the client 
terminal and hypervideo mail server computer; 
Fig. 43 is a partial system block diagram of the four- 
teenth embodiment, configured as a plurality of 
interconnected LANs (local area networks; 
Fig. 44 is a conceptual system diagram corre- 
sponding to Fig. 43, for illustrating data flows within 
the system of Fig. 43; 

Fig. 45 is a partial system block diagram of the four- 
teenth embodiment, showing in greater detail the 
respective data flows which occur during 
exchanges of hypervideo mail items; 
Fig. 46 is a flow diagram showing the basic operat- 
ing sequence which occurs during transfer of a mail 
item, with the fourteenth embodiment; 
Fig. 47A and 47B are flow diagrams which respec- 
tively illustrate operating sequences of a hyper- 
video mail processing section and a destination 
enquiry management section, of the fourteenth 
embodiment; 

Fig. 48 is a system block diagram showing the basic 
components of a f ifteenth embodiment of the inven- 
tion, which is an information provider apparatus 
having a hypervideo mail processing capability, and 
which is suitable for being configured as a plurality 
of interconnected LANs; 

Fig. 49 is a conceptual diagram for illustrating 
respective examples of the data configurations of a 
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hypervideo mail item and a reference mail item, 
used with the fifteenth embodiment; 
Fig. 50 is a conceptual system diagram of the fif- 
teenth embodiment, configured as a plurality of 
mutually communicating LANs, for illustrating s 
respective flows of data within and between the 
. LANs; 

Fig. 51 is a partial system block diagram of the fif- 
teenth embodiment, showing a respective hyper- 
video mail server computers of two LANs, w 
connected to one client terminal of each of the 
LANS, for illustrating the transfer of a hypervideo 
mail item between the two client terminals, based 
on the use of a corresponding reference mail item; 
Rg. 52 is a conceptual diagram for illustrating 15 
respective examples of data configurations of 
WWW data and hypervideo data, stored in the fif- 
teenth embodiment, prior to a certain hypervideo 
mail item being received by a mail server computer; 
Fig. 53 is a diagram corresponding to Fig. 52, 20 
showing the respective WWW data and hypervideo 
data configurations after the hypervideo mail item 
has been received; 

Fig. 54 is a partial system block diagram showing 
the basic internal configurations of a client terminal 25 
and mail server computer of a LAN, with the fif- 
teenth embodiment; 

Fig. 55 is a flow diagram for illustrating the basic 
operation sequence which is executed for transfer- 
ring a reference mail item, corresponding to a 30 
hypervideo mail item, to the server computer of a 
destination client terminal, with the fifteenth embod- 
iment; 

Fig. 56 is a flow diagram for illustrating the basic 
operation sequence which is executed for transfer- 35 
ring a hypervideo mail item between two client ter- 
minals, with the f rfteerrth embodiment; 
Rg. 57 is a system block diagram of a sixteenth 
embodiment of the invention, which is an informa- 
tion provider apparatus having a hypervideo mail 40 
processing capability, configured as a plurality of 
LANs which mutually communicate via data com- 
munication paths which extend through a wide area 
network; 

Fig. 58 is a partial system block diagram of the six- 45 
teenth embodiment, showing the basic internal 
configurations of a mail server computer and a cli- 
ent terminal of a LAN; 

Fig. 59 is a block diagram showing the internal con- 
figuration of a hypervideo mail processing section so 
of the mail server computer of Fig. 58; 
Fig, 60 is a flow diagram showing the basic opera- 
tion sequence which is executed for transferring a 
hypervideo mail item between two client terminals, 
with the sixteenth embodiment; 55 
Fig. 61 is a partial system block diagram of a seven- 
teenth embodiment which is a modification of the 
sixteenth embodiment, showing the basic internal 
configurations of a mail server computer and a cli- 



ent terminal of a LAN; 

Rg. 62 is a block diagram showing the internal con- 
figuration of a hypervideo mail processing section 
of the mail server computer of Rg. 61 ; 
Rg. 63 is a flow diagram showing the basic opera- 
tion sequence which is executed for transferring a 
hypervideo mail item between two client terminals, 
with the seventeenth embodiment; 
Rg. 64 is a flow diagram showing the basic opera- 
tion sequence which is executed for transferring a 
hypervideo mail item between two client terminals, 
with an eighteenth embodiment, which has the 
same physical configuration as the seventeenth 
embodiment; 

Fig. 65 is a flow diagram showing the basic opera- 
tion sequence which is executed for transferring a 
hypervideo mail item between two client terminals, 
with a nineteenth embodiment, which has the same 
physical configuration as the seventeenth embodi- 
ment; 

Rg. 66 is a system block diagram of an example of 
a prior art type of information provider apparatus; 
Rg, 67 shows an example of WWW data written in 
HTML, for use with the information provider appara- 
tus of Fig. 66; 

Rg. 68 shows an example of a playing control table, 
which is stored in an information browsing control 
section of the prior art information provider appara- 
tus of Fig. 66; 

Rg. 69 is a flow diagram showing the basic opera- 
tion sequence of the prior art information provider 
apparatus of Rg. 66; 

Rg. 70 is a flow diagram showing a processing 
sequence which is executed by a browsing control 
section of the prior art information provider appara- 
tus of Rg. 66; 

Rgs. 71 A and 71 B show examples of WWW data 
which are stored in a WWW data storage section of 
the prior art information provider apparatus of Rg: 
66; 

Rg. 72 shows examples of successive display pic- 
tures which are generated during operation of the 
prior art apparatus of Fig. 66; 
Rg. 73 is a simple block diagram for illustrating the 
basic principles of a twentieth embodiment of the 
invention, which is a data processing apparatus 
enabling hypervideo messages to be received from 
local sources, such as client terminals of a local 
area network, and posted on a specif ic notice board 
page, while in addition being distributed to specific 
remote destinations (i.e. specific other sites of a 
wide-area network) to be posted; 
Fig. 74 is a system block diagram showing details of 
the embodiment of Rg: 73; 

Rg. 75 is a system block diagram showing an 
example of a client terminal and a server computer 
configured in accordance with the twentieth embod- 
iment, for use in a wide-area network; 
Rg. 76 is a diagram for illustrating the process of 
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distribution of a hypervideo message between sites 
of a wide-area network; 

Fig. 77 shows an example of the format of detection 
result data, which are used with the twentieth 
embodiment, conveying summary information con- s 
cerning a posted hypervideo message; 
Figs. 78A, 78B, 78C are table examples to illustrate 
the format of a distribution condition table, used 
with the twentieth embodiment to specify those 
destinations to which a posted hypervideo mes- 10 
sage is to be distributed; 

Fig. 79 illustrates the data format of a distribution 
file group containing the data of a hypervideo mes- 
sage as a set of files; 

Fig. 80 is a flow diagram for illustrating the basic is 
operation of the twentieth embodiment, based on 
the message distribution example of Fig. 76; 
Fig. 81 is a flow diagram for illustrating a processing 
sequence executed by a distribution transmitting 
section of the twentieth embodiment; 20 
Fig. 82 is a flow diagram for illustrating a processing 
sequence executed by a distributed message 
receiving section of the twentieth embodiment; 
Fig. 83 is a conceptual diagram for illustrating a 
synchronization relationship between server com- 25 
puters which respectively distrfcute and receive a 
hypervideo message, with the twentieth embodi- 
ment; 

Fig. 84 shows an example of the format of message 
updating information, conveying the notice board so 
name and message theme of a hypervideo mes- 
sage in conjunction with storage location informa- 
tion for the message contents, for use with a 
twenty-first embodiment of the invention; 
Fig. 85 is a flow diagram showing the basic opera- 35 
tion sequence executed by a distribution transmit- 
ting section of the twenty-first embodiment; 
Fig. 86 is a flow diagram for illustrating a processing 
sequence executed by a distributed message 
receiving section of the twenty-first embodiment; 40 
Fig. 87 is a conceptual diagram for illustrating a 
synchronization relationship between server com- 
puters which respectively distrfixrte and receive a 
hypervideo message, with the twenty-first embodi- 
ment; 45 
Fig. 88 is a system block diagram showing the basic 
configuration of a twenty-second embodiment of 
the invention, which also is a data processing appa- 
ratus enabling hypervideo messages to be received 
from local sources, such as client terminals of a so 
local area network, and posted on a specific notice 
board page, while in addition being distributed to 
specific remote destinations, to be subsequently 
posted on notice boards of these destinations at 
arbitrarily scheduled times; 55 
Fig. 89 shows an example of an execution schedule 
table, for use with the twenty-second embodiment; 
Figs. 90A f 90B are flow diagrams for illustrating the 
operation of a distribution message receiving sec- 



tion of the twenty-second embodiment; 
Figs. 91 A, 91 B are conceptual diagrams for illus- 
trating a synchronization relationship between 
server computers which respectively distribute and 
receive a hypervideo message, with the twenty- 
second embodiment; 

Fig. 92 is a conceptual diagram for illustrating a 
process of encoding and subsequently decoding a 
hypervideo message to/from the form of an elec- 
tronic mail item, as executed with a twenty-third 
embodiment of the invention; 
Fig. 93 is a simple system block diagram for illus- 
trating a condition in which hypervideo message 
data cannot be transferred between sites of a wide- 
area network by using a file transfer protocol (FTP), 
due to absence of a continuously connected data 
path; 

Fig. 94 is a flow diagram for illustrating a processing 
sequence executed by a distribution transmitting 
section of the twenty-third embodiment; 
Fig. 95 is a flow diagram for illustrating a processing 
sequence executed by a cfistributed message 
receiving section of the twenty-third embodiment; 
Fig. 96 is a conceptual diagram for illustrating a 
synchronization relationship between server com- 
puters which respectively distribute and receive a 
hypervideo message, with the twenty-third embodi- 
ment; 

Fig. 97 is a partial system block diagram, showing 
the basic features of a twenty-fourth embodiment of 
the invention, which also is a data processing appa- 
ratus enabling hypervideo messages to be received 
from local sources, such as client terminals of a 
local area network, and posted on a specific notice 
board page, white in addition being distributed to 
specific remote destinations; 
Fig. 98A "is a simple system block diagram for illus- 
trating a condition in which hypervideo message 
data cannot be transferred between sites of a wide- 
area network by using a file transfer protocol (FTP), 
due to use of a "firewall" protection feature, and Fig. 
98B is a table showing an example of possibilities of 
using data communication protocols, correspond- 
ing to Fig. 98A; 

Fig. 99 shows an example of the format of retrans- 
mission request data, used with the twenty-fourth 
embodiment; 

Fig. 100 is a flow diagram showing the basic opera- 
tion sequence executed by the twenty-fourth 
embodiment, for hypervideo message distribution 
processing; 

Fig. 101 is a flow diagram for illustrating a process- 
ing sequence executed by a 1st distribution trans- 
mitting section of the twenty-fourth embodiment; 
Fig. 102 is a flow diagram for illustrating a process- 
ing sequence executed by a 1st distributed mes- 
sage receiving section of the twenty-fourth 
embodiment; 

Fig. 103 is a flow diagram for illustrating a process-r 
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ing sequence executed by a 2nd distributed mes- 
sage receiving section of the twenty-fourth 
embodiment; 

Fig. 104 is a flow diagram for illustrating a process- 
ing sequence executed by a distributed message s 
data input processing section of the twenty-fourth 
embodiment; and 

Fig. 105 is a conceptual diagram for illustrating a 
synchronization relationship between server com- 
puters which respectively distribute and receive a 10 
hypervideo message with the twenty-fourth embod- 
iment. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

15 

The basic principles of the present invention will 
first be described, referring to Fig.1. It will be assumed 
that data, stored as files, are acquired from storage and 
played, with the necessary apparatus being described 
hereinafter. As stated hereinabove, an information pro- 20 
vider apparatus according to the present invention oper- 
ates on hypervideo data which consist of : 

(a) Subject matter data, which express the actual 
contents which are to be played (where "played" is 25 
used in the most general sense, applying to playing 

of audio or video data and also to displaying of text 
or still picture data). Thus the subject matter data 
consist of at least one video data file (of a reference 
video clip, described hereinafter), and monomedia 30 
data files which may include one or more video data 
files, still picture data files, audio data files, and/or 
text data files. 

(b) A file of scenario data, which contains informa- 
tion indicating the storage locations of the subject 35 
matter data, e.g. directory path and file name infor- 
mation for each of the subject matter data files. The 
scenario data further includes playing information 

for the subject matter data. Specifically, the playing 
information at least expresses, for each of the sub- 40 
ject matter data files, the time at which the corre- 
sponding data are to begin to-be played (i.e. in 
relation to the start of playing the hypervideo data), 
and the position and size of the display screen 
region in which the data are to be displayed (in the 45 
case of data other than audio data). In the case of 
data which is not of continuous form, such as text or 
still picture data, the scenario data for a subject 
matter data file may also specify the time at which 
playing of the file contents is to to be ended. so 

The basic principles of playing the hypervideo data 
will be described referring to the conceptual diagram of 
Fig.1 , in which numeral 101 denotes data that in combi- 
nation constitute the subject matter of a complete set of 55 
hypervideo data. Such a set will be referred to in the fol- 
lowing as a hypervideo clip (by analogy with the terms 
"video clip" and M audio clip") The hypervideo data 101 
are made up of a combination of data files which include 



data of one or more video clips, and also may include 
data of audio clips, text data, and still picture data. How- 
ever the hypervideo data 101 contains at least a refer- 
ence video data file 102, i.e. a file whose video frame 
numbers are used as reference data, and whose con- 
tents are played extends continuously from the start to 
end of playing the hypervideo data 101 . The video data 
102 will be assumed to be stored and accessed as a file 
which is named al.mpeg. The successive frame num- 
bers of the reference video data 1 02 are used as timing 
references for the start of playing other components of 
the hypervideo data 101, which in this simple example 
include the still picture data 103 (from a file named 
a2.gif), the text data 1 04 (from a file named a3.text), and 
the video data 105 (from a file named a2.mpeg), as 
shown in Fig. 1. In the example of Fig.1, at the com- 
mencement of playing the hypervideo clip, only the con- 
tents of the reference video data 102 are acquired and 
displayed, with the size and position of the resultant dis- 
play picture being determined by the scenario data. 
When playing of frame 1 02a of reference video data 1 02 
begins, the still picture of data 103 is acquired and 
begins to be displayed, combined with any image which 
is currently being displayed as a result of the video data 
102, with attributes such as the size and screen position 
of that still picture being determined by the scenario 
data. When playing of frame 1 02b of the reference video 
data 102 begins, the text data 104 also is acquired and 
begins to be displayed (again, in a manner specified by 
the scenario data contents) together with the other data 
which are being displayed. At reference frame number 
102c, as specified by the scenario data, display of the 
still picture data 103 is halted. When the reference 
frame number 102d is reached, then the video data 105 
begins to be acquired continuously, and played as it is 
being acquired, with the display size and screen posi- 
tion of the resultant video picture being determined by 
the scenario data. At the reference frame number 102e, 
again as specified by the scenario data, display of the 
text data 1 04 is halted. 

In that way, control of playing the hypervideo data to 
provide a multimedia presentation can be easily imple- 
mented, based on the subject matter data and the con- 
tents of the scenario data together with a count of the 
number of video frames of the reference video data 102 
which have been played. 

Fig. 2 is a simple system block diagram showing the 
basic elements of a first embodiment of an information 
provider apparatus according to the present invention 
This consists of an I/O section 110, an information 
browsing section 120, a data communication path 140, 
a WWW data service section 130 and a hypervideo 
data service section 150. Wrth this embodiment, the 
data communication path 140 has a sufficiently wide 
transmission bandwidth to enable real-time transfer of 
video data over that communication path to a video dis- 
play apparatus at a sufficiently high data transfer rate to 
enable continuous-motion display of the data contents. 
The I/O section 1 1 0 and WWW data service section 1 30 
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respectively correspond to the I/O section 1 and WWW 
data service section 3 of the prior art information pro- 
vider apparatus example of Fig. 66, described above, 
with the I/O section 110 consisting of a input apparatus 
1 1 1 and a display apparatus 112, and the WWW data 5 
service section 1 30 consisting of a WWW data manage- 
ment^ section 132 and a WWW data storage section 
131. However the information browsing section 120, in 
addition to including a browsing control section 121, an 
acquired data storage section 122 and a monomedia w 
data playing section 123, differs from the information 
browsing section 2 of the prior art information provider 
apparatus example by further including a hypervideo 
data playing section 1 24. The function of the hypervideo 
data playing section 124 is to execute playing of 75 
acquired hypervideo data, based upon the contents of 
acquired scenario data and upon reference video frame 
numbers as described above. The hypervideo data 
service section 150 consists of a hypervideo data stor- 
age section 151 which stores hypervideo data (i.e. sub- 20 
ject matter data together with related scenario data, as 
described above) and a hypervideo data management 
section 152 which controls outputting of selected parts 
of the stored hypervideo data in accordance with exter- 
nally supplied data transfer requests which are sent 25 
from the information browsing section 120. 

In addition to the HTTP (Hypertext Transfer Proto- 
col) communication system 141, which is used for 
hypertext data communication between the information 
browsing section 120 and WWW data service section 30 
130, the data communication path 140 further includes 
a NFS (Network File System, a registered trade mark of 
Sun Microsystems Inc., U.S.A.) communication system 
142, i.e. a data communication system utilizing the NFS 
protocol for high-speed data transfer via the data com- 35 
munication path 140, between the information browsing 
section 120 and hypervideo data service section 150. It 
should be understood that Fig. 2 is essentially a con- 
ceptual block diagram, and that the data communication 
path 1 40 will in general consist of a single physical com- 40 
munication path, with data being routed between the 
information browsing section 120 and the WWW data 
sen/ice section 1 30 and hypervideo data management 
section 152 in accordance with the communication pro- 
tocol which is being utilized, i.e. the HTTP or the NFS 45 
communication protocol. More specifically, the HTTP 
communication system 141 represents respective soft- 
ware (communication application programs) and hard- 
ware which are provided within the browsing control 
section 121 and WWW data management section 132, so 
which implement data communication via the data com- 
munication path 140, using the HTTP. Similarly, the NFS 
communication system 142 represents respective soft- 
ware and hardware which are provided within the hyper- 
video data playing section 124 and hypervideo data 55 
management section 1 52, which implement data com- 
munication via the data communication path 140 using 
the NFS protocol. 

When data are transferred over a communication 



path by using the HTTP, e.g. transferred from the WWW 
data storage section 131 to the information browsing 
section 120 in Fig. 2, then in general, all of the trans- 
ferred data (a page of hypertext data or a monomedia 
data file) must first be stored in memory at the receiving 
side, i.e. a downloading operation must be completed 
before playing of the received data can begin. However 
data transfer using a communication protocol such as 
the NFS protocol is executed in a basically different 
manner. When a communication program which imple- 
ments the NFS protocol is invoked, e g. by a client ter- 
minal which is coupled via a data communication path 
to a server computer, the client terminal becomes ena- 
bled to directly access the contents of data files which 
are stored at the server computer. Thus, it is not neces- 
sary for the client terminal to download all of the data of 
a monomedia data file before starting to play the con- 
tents of the file. Instead, the client terminal can play the 
file data, by substantially real-time operation, as they 
are successively received. With recent advances which 
have been made in communication and computer tech- 
nology, it has thereby become possible to use a such a 
communication technique to enable a client terminal to 
generate a real-time video display as the video data are 
being successively transferred from a server computer. 
In addition, with the NFS system, it is possible for a plu- 
rality of data files of a server computer to be accessed 
simultaneously by one or more client computers. 

Although it is assumed in this description that the 
NFS communication system is utilized, it would of 
course be equally possible to utilize any other data com- 
munication system which provides similar file access 
capabilities and is capable of transferring video data 
over a communication path to a video display apparatus 
at a sufficiently high transfer rate to enable continuous- 
motion display of the video data contents during real- 
time data transfer. 

The above points are illustrated in Fig. 3, which 
conceptually shows an example of the contents of 
hypervideo data which relate to a specific hypervideo 
clip. This consists of WWW data 201 which are trans- 
ferred by using the HTTP communication system 141 
and are stored and managed by the WWW data service 
section 130, and hypervideo data 202 which are trans- 
ferred by using the NFS communication system 142 and 
are stored and managed by the hypervideo data service 
section 150. In the example of Rg. 3, the WWW data 
201 contain the following: 

Data of a hypertext page (ahtml). and scenario data 
(a.refl 

As shown, the hypertext page contains a hyperlink 
to scenario data (a.ref) for a specific hypervideo clip. 
The scenario data consist of information which specif ies 
where the scenario data file of the hypervideo dip are 
being held in the hypervideo data storage section 151. 
In this example, the information is assumed to consist 
simply of the scenario file name (a.sci), however in gen- 
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eral, directory path information for that scenario file may 
also be included. 

The hypervideo data 202 contains the following: 

(a) Scenario data (a.sci) 5 

* This is a data file which, as described above, con- 
tains information specifying the storage locations of the 
subject matter data files (i.e. the files at.mpeg, a2.gif, 
a3.text) and also playing information, which relates to 10 
control of playing the subject matter data contents, i.e. 
data which specify times of starting to play specific parts 
of the component media data of a hypervideo data clip 
(determined on the basis of frame numbers of a refer- 
ence video clip as described above), etc. 15 

(b) Subject matter media data (Lmpeo). (a2.gif). 
(a3.text) 

This consists of a plurality of monomedia data files 20 
containing the media data which are actually played, 
and which in conjunction with the scenario data (a.sci) 
constitute the hypervideo data of this hypervideo clip. 

Fig. 4 shows an example of the contents of a play- 
ing control table 203 which is held in the browsing con- 25 
trol section 121 of the information browsing section 120. 
In addition to the records which are identical in form and 
function to those of the playing control table 24 of the 
prior art apparatus, shown in Fig. 68, i.e. records for the 
respective file extensions ".html", w giT, and "mpeg", the 30 
playing control table 203 further includes a record for 
the file extension ".ref. This file extension is used in the 
file name of any scenario data file. When such a file is 
transferred to the information browsing section 120 in 
response to a hyperlink data transfer request, the 35 
browsing control section 121 first stores the contents in 
the acquired data storage section 122. then detects the 
file extension ".ref by referring to the playing control 
table 203, and responds by causing the hypervideo data 
playing section 124 to send a request (using the NFS 40 
communication system 142) to the hypervideo data 
service section 1 50 for the corresponding scenario data 
file. When for example the scenario data file "a.ref con- 
taining as data contents the file name "a.sci", is 
received by the browsing control section 121, and 46 
stored in the acquired data storage section 122, a pro- 
gram (designated as the HV-ref-play player program in 
Fig. 4) is invoked, whereby the hypervideo data playing 
section 124 sends a data transfer command to the 
hypervideo data management section 1 52 such that the so 
hypervideo data playing section 124 is enabled to begin 
reading out the contents of the corresponding scenario 
data file "a.scr from the hypervideo data storage sec- 
tion 151, via the data communication path 140. The 
hypervideo data playing section 124 then begins to 55 
operate in accordance with the scenario data contents. 
Specifically, after various initialization processing has 
been completed, the hypervideo data playing section 
124 sends to the hypervideo data service section 150 a 



data transfer request for accessing the file of the refer- 
ence video clip of the specified hypervideo clip, invokes 
the "mpeg-play" player program, and begins to continu- 
ously transfer the reference video data from the hyper- 
video data storage section 151 via the data 
communication path 140 using the NFS communication 
system 142, to be played by the display apparatus 1 12. 
Thereafter, the other monomedia data contents of the 
specified hypervideo dip are similarly transferred from 
the hypervideo data storage section 151 to the hyper- 
video data playing section 124, using the NFS commu- 
nication system 142, and are played by the display 
apparatus 1 12, at times which are determined based on 
the contents of the scenario data and the elapsed 
number of frames of the reference video data, as 
described hereinabove. That processing continues until 
the end of the scenario, i.e. until the final frame of the 
reference video clip has been played. 

Fig. 5 is a flow diagram showing the operating 
sequence executed by the information browsing section 
120 of this embodiment. In Fig. 5, steps 21, 22 and 23 
correspond to steps 1. 2 and 3 in the flow diagram of 
Fig. 69 for the prior art example described hereinabove, 
so that it can be understood that the operations which 
must be executed by a user are similar to those of the 
prior art example. The processing steps are as follows: 

Step 21 : A request for transfer of the home page is 
sent by the browsing control section t21 via the 
data communication path 140, using the HTTP 
communication system 141, to the WWW data 
service section 130. The transferred data are 
stored in the acquired data storage section 122, 
and displayed by the display apparatus 1 1 2. 
Step 22: The system waits to receive a hyperlink 
selection input, or a "terminate operation" input 
from the user, via the input apparatus 111. 
Step 23: A judgement is made, in accordance with 
the user input operation, to either terminate opera- 
tion or to request selected WWW data from the 
WWW data service section 1 30. 
Step 24: The selected WWW data are transferred 
by the browsing control section 121 from the WWW 
data service section 130 to the information brows- 
ing section 120, using the HTTP communication 
system 141, and stored in the acquired data stor- 
age section 122. 

Step 25: A judgement is made, based on the file 
extension of the transferred WWW data and the 
contents of the playing control table 203, as to the 
type of data which have been selected. 
Step 26: If the transferred data are in HTML format, 
having the file extension ".html" (i.e. indicating a 
hypertext data page) then the data contents are 
supplied to the display apparatus 1 12, to update the 
displayed hypertext page data. 
Step 27: If the transferred data are monomedia 
data, e.g. having a file extension such as H .mpeg n or 
\gif*\ then the appropriate player program is 
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invoked by the monomedia data playing section 
1 23. and the data are played (displayed) by the dis- 
play apparatus 112. 

Step 28: If the transferred data are scenario refer- 
ence data (with file extension "ref") then the data s 
are supplied to hypervideo data playing section 
424, causing the hypervideo data playing program 
to be invoked, so that a request is sent to the hyper- 
video data service section 1 50 (using the NFS com- 
munication system 142) to access corresponding 10 
hypervideo scenario data file. Transfer and playing 
of the scenario data, and consequent transfer/clay- 
ing of the subject matter data of the corresponding 
hypervideo clip as described above, then begins, 
and operation returns to step 22. is 

Judgement of the type of data which have been 
transferred in step 24 is based on the file extension of 
the data, in conjunction with the contents of the playing 
control table 203. as described hereinabove. 20 

The operation sequence that is executed by the 
hypervideo data playing section 124. in step 28 of Fig. 
5. will be described referring to Fig. 6. and is as follows: 

Step 30: A selection input specifying a hypervideo 25 
dip is received from the user. 
Step 31 : The scenario reference file for that hyper- 
video clip is acquired, i.e. is read out from the 
WWW data storage section 131 of the WWW data 
service section 130. transferred via the data com- 30 
munication path 140 using the HTTP communica- 
tion system 141. and stored in the acquired data 
storage section 1 22. 

Step 32: The hypervideo data playing section 124 
then accesses the scenario data file of that hyper- 35 
video clip, which is stored in the hypervideo data 
storage section 151 of the hypervideo data service 
section 150. and begins to receive the data of that 
file, transferred via the data communication path 
140. using the NFS communication system 142. 40 
Step 33: After executing various initialization opera- 
tions, the hypervideo data playing section 124 
begins to access the data f fle of the ref erence video 
clip of the selected hypervideo clip, stored in the 
hypervideo data storage section 151 , and to trans- 45 
fer (via the data communication path 140. using the 
NFS communication system 142) and play the con- 
tents of the reference video data file of the specified 
hypervideo clip, while counting successive refer- 
ence video frame numbers. Thereafter, the loop of so 
steps 34 to 38 is repetitively executed in accord- 
ance with the scenario data, until the end of the 
scenario is reached or the user selects termination 
of playing. 

Step 34: If it is found that the end of the scenario 55 
has been reached (for example, the final frame 
number of the reference video clip has been 
reached) or if the "terminate" button has been 
selected by the user, then operation returns to step 



22 of the processing flow of Fig. 5. Otherwise, oper- 
ation proceeds to step 35. 

Step 35: A judgement is made as to whether, at this 
point in playing the hypervideo data, the scenario 
data require that new subject matter data are to be 
read out from the hypervideo data storage section 
151 and played. If so, step 36 is executed. If not, 
operation proceeds to step 37. 
Step 36: The hypervideo data playing section 124 
accesses and transfers the contents of the required 
subject matter data file from the hypervideo data 
storage section 151 (via the data communication 
path 140, using the NFS communication system 
142) is started, and the data are played by the 
hypervideo data playing section 124 and display 
apparatus 1 1 2. In the case of continuous-type data 
(i.e video or audio data), the data are successively 
transferred to and played by the display apparatus 
112, as they are received from the data communi- 
cation path 140. 

Step 37: A decision is made as to whether it is nec- 
essary to end playing of a hypervideo item, e.g. to 
end displaying of a text or still picture item, the deci- 
sion being based on the scenario data contents and 
the reference frame number count. 
Step 38: Playing of that item is terminated, if so 
decided in step 37. Accessing of the corresponding 
subject matter data file in the hypervideo data stor- 
age section 151 by the hypervideo data playing 
section 124 is terminated. Operation then returns to 
step 34. 

Fig. 7 shows an example of WWW data which might 
be stored in the WWW data storage section 131 of the 
WWW data service section 130 of this embodiment. 
Fig. 8 shows a corresponding example of hypervideo 
data which might be stored in the hypervideo data stor- 
age section 151 of the hypervideo data service section 
150. In Fig. 7, 204 is a home page of hypertext data, 
205. 206 and 207 denote respective page units of 
hypertext data which are connected by hyperlinks to the 
home page 204, while 208 to 213 denote respective 
monomedia data files which are connected by hyper- 
links to the hypertext pages 205, 206 and 207. The 
monomedia data files 212, 213 are respective scenario 
reference files (hvl.ref, hv2.ref)- These scenario refer- 
ence files respectively contain the file names (hvt.sci, 
hv2.sd) of two scenario data files, as indicated by 
numerals 214, 215 in Fig. 8. 

As illustrated in Fig. 8, each of the scenario data 
files consists of a section, such as section 214a, which 
provides information indicating the storage locations of 
the subject matter data files 214c of the corresponding 
hypervideo clip, and a section such as section 214b 
which contains playing information for subject matter 
data files 214c. In this example, it is assumed that the 
storage location information simply consists of a list of 
file names of the subject matter data files. 

An example of the operation of this embodiment will 
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be described referring to Fig. 9, assuming that the 
WWW data and hypervideo data shown in Figs. 7 and 8 
are utilized. Firstly, on start-up, the display produced by 
the display apparatus 112 will become as indicated by 
numeral 216 in Fig. 9, Le. containing the home page 5 
216a, in which hyperlink items are displayed in under- 
lined form, together with text contents of the home page. 
In this example, the user can select either monomedia 
data items (i.e. the set of still picture items, the set of 
video items) or the set of hypervideo items. If the hyper- w 
video set is selected (e.g. the user uses a mouse which 
is part of the input apparatus 1 1 1 , in conjunction with a 
display cursor, to "click on" the underlined item "Hyper- 
video picture set"), then the display produced by the dis- 
play apparatus 1 1 2 will become as indicated by numeral 15 

217, Le. the hypervideo- page 217a will appear, which 
contains two hyperlink items (sample 1 and sample 2), 
linked to respective hypervideo clips. If the user selects 
one of these two hyperlink items, then the processing of 
step 28 of Fig, 5, described above, is put into operation. 20 
As a result, playing of the specified hypervideo clip 
begins, so that the display produced by the display 
apparatus 112 will become as indicated by numeral 

2 1 8, i. e. the hypervideo page 2 1 7a will remain displayed 

in the background, while the (visual) contents of the 2 s 
selected hypervideo clip will be displayed in the fore- 
ground, as indicated by numeral 218. The displayed 
contents of the hypervideo clip are designated as 218a. 
These contents, in this example, consist of a text portion 
21 8d. a video picture 218e, and a still picture 21 8f, with 30 
the video picture 21 8a being generated by the reference 
video clip. In addition, buttons (i.e. for use with a point- 
ing device such as a mouse) for use in controlling the 
hypervideo display also appear on the display screen, 
as designated by 218b, together with an "end" button 35 
218c for use in terminating the hypervideo playing oper- 
ation when desired. 

If on the other hand the user selects the static pic- 
ture set or the video set, from the home page hyperlink 
items, then the operation will proceed as described 40 
hereinabove for the prior art apparatus example of Figs. 
71 A, 71 B. 

With the first embodiment of an information pro- 
vider, apparatus described above, the programs for 
obtaining hypervideo data (from the hypervideo data 45 
service section 150) and playing the data in accordance 
with the scenario data are invoked automatically, when 
the user selects a hypervideo item to be played. The 
user performs that selection (by means of hyperlink 
items which appear within a displayed page of hypertext 50 
information) in the same way as is conventionally used 
to select WWW data, i.e. to select a new hypertext data 
page or to select a monomedia data item. Thus, the 
embodiment is extremely convenient and simple for the 
user. 55 

Moreover, the implementation of hypervideo selec- 
tion and playing functions can be very easily performed, 
due to the use of the scenario data files as an interme- 
diary between the hyperlinks of the conventional hyper- 



text data and the complex combinations of various types 
of media data which constitute the hypervideo data. 
That is to say, rather than attempting to directly link the 
hypervideo data to the conventional hypertext data, 
hyperlinks are established from hypertext data (such as 
the hypertext data page 217a shown in the example of 
Fig. 9) to the scenario data files. When a scenario data 
file is thereby downloaded from the WWW data that is 
held in the WWW data service section 130, that fact is 
detected by the information browsing section 120 
(based on the file extension of the downloaded data), 
whereupon a program is invoked for reading out the cor- 
responding hypervideo reference data from the hyper- 
video data service section 150 (using the NFS 
communication system 142), so that the subject matter 
data contents of the selected hypervideo clip can there- 
after be acquired and played in accordance with the 
scenario data as described hereinabove. As a result, 
provision of the hypervideo selection and playing capa- 
bility does not result in any substantial increase in com- 
plexity of data management. 

Furthermore with this embodiment, during playing 
of hypervideo. any necessary subject matter data (and 
in particular, video data) can be directly accessed by the 
information browsing section 120 and played as it is 
received, without the need to first store the subject mat- 
ter data in memory within the information browsing sec- 
tion 120. This is due to the fact that the subject matter 
data are accessed by using a communication system 
such as the the NFS communication system 142, As a 
result, when a user selects a specific hypervideo clip 
(using a hyperlink within a hypertext data page as 
described above) playing of the selected hypervideo 
can begin almost immediately, i.e. the amount of delay 
between the time at which the user selects a hypervideo 
clip and the time at which playing of the selected data 
begins is much shorter than would be the case if all of 
the hypervideo subject matter data had to be down- 
loaded by the information browsing section 120 before 
playing of the hypervideo could begin. 

The above embodiment has been described only 
with regard to playing of hypervideo, i.e. with the sce- 
nario data for the hypervideo being acquired by the 
information browsing section 120 via the data communi- 
cation path 140 by means of the HTTP communication 
system 141, and all of the hypervideo data being 
acquired from the hypervideo data service section 150 
by means of the HTTP communication system 141. 
However it would be equally possible to apply similar 
principles to shortening the time delay which elapses 
between the point at which a user selects an monome- 
dia data item such as a video clip and the point at which 
playing of the selected monomedia data item begins. In 
the case of a video clip for example that could be 
achieved by: 

(a) storing the actual video data (i.e. subject matter 
data) within the hypervideo data storage section 
151, 
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(b) storing in the WWW data storage section 131a 
video reference file (having a specific file extension, 
such as ".vre" for example) containing information 
which specifies the storage position of the video 
data within the hypervideo data storage section 151 5 
(e.g. the file name under which the video data are 
Stored), and 

(c) configuring the information browsing section 
120 (i.e. by providing additional records in the play- 
ing control table 203, for file extensions such as 
".vre" of monomedia data reference information) to 
detect that a monomedia data reference informa- 
tion file has been transferred from the WWW data 
service section 130 by the HTTP communication 
system 141 and stored in the acquired data storage 
section 122, and to respond to such a condition by 
using the file contents to c&rectly begin to read out 
and to play the contents of the corresponding video 
data file, from the hypervideo data service section 
150, using the NFS communication system 142. 

It will be apparent that such an information provider 
apparatus would have a much shorter amount of time 
delay between selection of a monomedia data item 
(using a hyperlink) and the the start of playing of the 
selected item, than has been possible with a prior art 
type of information provider apparatus, with which it is 
necessary to completely download an entire monome- 
dia data fPe (by HTTP transfer) before playing of the 
monomedia data can begin. It will also be apparent that 
such a capability can very easily be added to the func- 
tions of the first embodiment described above. 

Furthermore the above embodiment has been 
described on the assumption that the NFS data commu- 
nication protocol is used for transferring hypervideo 
data to the information browsing section 120, i.e. that 
the information browsing section 120 executes the nec- 
essary data communication program for implementing 
the NFS protocol and that the information browsing sec- 
tion 120 and hypervideo data service section 150 are 
equipped with the necessary data processing hardware 
which are required for NFS communication. However it 
would be equally possible to use any other data transfer 
system, which enables the information browsing section 
120 to directly access (via the data communication path 
1 40) the contents of files which are stored at the hyper- 
video data service section 150 and transfer the ffle con- 
tents at a sufficiently high data rate to permit 
continuous-motion display of transferred video data, 
and which also enables concurrent accessing of a plu- 
rality of files which are stored in the hypervideo data 
service section 150 

In particular, if the hypervideo data includes large 
amounts of video data, i.e. data which must be read out 
continuously at high speed from the hypervideo data 
storage section 1 51 of the hypervideo data service sec- 
tion 150 (which in general will consist of a high-capacity 
hard disk storage device), then it may be preferable to 
use a data communication program such as Vide- 



oShower (a registered trademark of Matsushita Electric 
Industrial Co. Ltd., Japan), which enables video data to 
be read out from hard disk storage and supplied simul- 
taneously, without interruptions, to a plurality of client 
terminals, by using a rate control technique. 

A second embodiment of the invention will be 
described, which has the same apparatus configuration 
as for the first embodiment, described above and shown 
in Fig. 2, but differs with respect to storing and manage- 
ment of data. Fig. 10 shows an example of the WWW 
data 301 which are handled by the WWW data service 
section 1 30 and the hypervideo data 302 which are han- 
dled by the hypervideo data service section 150, with 
this embodiment. In Fig. 10, the WWW data 301 have 
the following constituents. Firstly, there is hypertext 
page data, including the page w b.html\ which contains a 
hyperlink to a scenario data file **b.sc1". That scenario 
data file is a text file which is also a part of the WWW 
data 301 . In the same way as for a scenario data file of 
the first embodiment described above, such a scenario 
data file contains storage location information (such as 
a list of file names) for the subject matter data of respec- 
tive hypervideo clips, i.e. locations where the subject 
matter data are stored in the hypervideo data storage 
section 151 of the hypervideo data service section 150, 
and playing control information for the respective sub- 
ject matter data. 

"The hypervideo data 302 of this embodiment, held 
in the hypervideo data storage section 151, consists 
only of the hypervideo subject matter data. In this exam- 
ple, the subject matter data consists of the monomedia 
data files "b1 .mpeg\ "b2.gif\ and "b3.texr (i.e. for a sin- 
gle hypervideo clip). 

Fig. 1 1 shows an example of the structure of a play- 
ing control table 303 which is held in the browsing con- 
trol section 121 of the information browsing section 120 
of this embodiment. This table is similar in format to the 
playing control table 203 of the first embodiment 
described above, shown in Fig. 4, but differs in that the 
".ref* record has been replaced by a ".sc1" record, 
which relates to hypervideo scenario data. With this 
embodiment, when the browsing control section 121 
detects that a file having the file extension ".sc1" has 
been transferred from the WWW data service section 
130 and stored in the acquired data storage section 
122, a player program "Hy-sct-play" is invoked for play- 
ing the hypervideo, and thereafter, the respective sub- 
ject matter data are transferred by the hypervideo data 
playing section 124 from the hypervideo data service 
section 150 using the NFS communication system 142, 
as determined by the contents of the scenario data f ile, 
in the same way as described for the first embodiment. 

Fig. 12 shows an example of the WWW data which 
are stored in the WWW data storage section 131 of this 
embodiment. In Fig. 12, 304 to 307 denote respective 
hypertext data pages, with 304 denoting the home 
page, and 308 to 313 denote respective monomedia 
data files. The monomedia data files 312 and 313 are 
respective scenario data files (hvl.sci, hv2.sci), which 
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are connected by hyperlinks to the hypertext page 307. 

It can thus be understood that this embodiment dif- 
fers from the first embodiment in that the scenario data 
are held in the WWW data storage section 131 rather 
than in the hypervideo data storage section 1 51 , so that s 
it becomes unnecessary to use scenario data files. 

The basic operation sequence of this embodiment 
is unchanged from that of the first embodiment 
described above, shown in Fig. 69. In addition, the 
processing sequence which is executed by the brows- w 
ing control section 121 in the information browsing sec- 
tion 120 of this embodiment is similar to that of the first 
embodiment shown in Fig. 5. However the operation of 
this embodiment differs with respect to the processing 
executed in step 28 by the hypervideo data playing sec- is 
tion 124 (i.e. to implement the HV-sci-play program). 
The contents of that step, for this embodiment, will be 
described referring to Fig. 13, and are as follows: 

v. Step 40: The system receives a selection input from 20 
the user, specifying a hypervideo clip. 
Step 41: The scenario file for the specified hyper- 
video clip is acquired, i.e. is read out from the 
WWW data storage section 131 of the WWW data 
service section 130, transferred via the data com- 25 
munication path 140 using the HTTP communica- 
tion system 141, and stored in the acquired data 
storage section 122. 

Step 42: After executing various initialization opera- 
tions, the hypervideo data playing section 124 30 
begins to access the data file of the reference video 
clip of the selected hypervideo dip, stored in the 
hypervideo data storage section 151 , and to trans- 
fer (via the data communication path 140, using the 
NFS communication system 142) and play the ref- 35 
erence video data, while counting successive refer- 
ence video frame numbers. Thereafter, the loop of 
steps 43 to 47 is repetitively executed to play the 
contents of the hypervideo clip in accordance with 

/ the scenario data, until the end of the scenario (cor- 40 
responding to the final frame of the reference video 
clip) is reached or the user selects termination of 

r playing. 

Step 43: If it is found that the end of the scenario 
has been reached or if the "end" button has been 46 
selected by the user, then operation returns to step 
22 of the processing flow of Fig. 5. Otherwise, oper- 
ation proceeds to step 44. 

Step 44: A judgement is made as to whether, at this 
point in playing the hypervideo data, the scenario so 
data require that new subject matter data are to be 
read out from the hypervideo data storage section 
151 and played. If so, step 45 is executed. If not 
operation proceeds to step 47. 

Step 45: Reading out of the required subject matter 55 
data file from the hypervideo data storage section 
151 (via the data communication path 140, using 
the NFS communication system 142) is started, 
and playing of the data by the hypervideo data play- 



ing section 124 and display apparatus 112 is 
started, with the data being played as they are 
received. 

Step 46: A decision is made as to whether it is nec- 
essary to end playing of a hypervideo item, e.g. to 
end displaying of a text or still picture item, the deci- 
sion being based on the scenario data and the ref- 
erence frame number count. 
Step 47: Playing of that item is terminated, if this 
has been decided in step 37. Accessing of the cor- 
responding file in the hypervideo data storage sec- 
tion 151 by the hypervideo data playing section 124 
is terminated. Operation then returns to step 43. 

The successive display pictures which are gener- 
ated by the display apparatus 1 1 2 during the above pro- 
cedure are identical in form to those illustrated by the 
examples of Fig. 9, for the first embodiment described 
above. 

As described in the above, with the second embod- 
iment of the invention, the structures of the WWW data 
and hypervideo data that are respectively handled by 
the WWW data service section 130 and hypervideo 
data service section 150 become as illustrated in Fig. 
10, rather than as illustrated in Fig. 3 for the first embod- 
iment By establishing the playing control table and the 
hypervideo playing operation sequence as illustrated 
respectively in Fig. 11 and Fig. 13, managing of the 
hypervideo data and providing hypervideo to the user 
can be easily performed. In addition, a user of a client 
terminal can designate that a specific hypervideo clip is 
to be played, by using conventional hyperlink selection 
operations while observing a displayed hypertext page, 
in the same way that has been generally utilized for 
selecting playing of specific monomedia data. It can 
thus be understood that the second embodiment pro- 
vides similar advantages to those of the first embodi- 
ment of the invention. 

Moreover with the second embodiment, it is not 
necessary to use the scenario reference data that are 
used with the first embodiment, so that the WWW data 
and the hypervideo data have the respective structures 
illustrated in Fig. 10. Hence, the overall data storage 
efficiency of the apparatus can be increased. 

A third embodiment of the invention will now be 
described. This embodiment uses a basically similar 
apparatus configuration to that of the first embodiment 
of an information provider apparatus, shown in Fig. 2. 
however this embodiment does not utilize the hyper- 
video data service section 150 and the NFS communi- 
cation system 142 for storing, handling and transferring 
hypervideo data, as required with the first two embodi- 
ments described above. Fig. 14 illustrates the structure 
of the WWW data 401 which are stored in the WWW 
data storage section 131 of this embodiment. With 
regard to hypervideo, the WWW data contains the fol- 
lowing types of data: 
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Hypertext page data (c.html) 

This hypertext page contains one or more hyper- 
links to respective sets of data files. Each of these sets 
includes the scenario data file and all of the monomedia s 
data files which constitute the subject matter data, for a 
specific hypervideo clip. Each of such sets of files is 
handled (with respect to hyperlink accessing of the 
WWW data service section 130 by the information 
browsing section 120) in the same manner as a single 10 
monomedia file, such as the files "pid.gif, and 
"movl.mpeg" in the hypertext data example of Fig. 7 
described hereinabove. Such a set of files will be 
referred to as a "title data file", and will assumed to be 
assigned (for the purpose of being selected by hyper- is 
link) the file extension ".tit", such as the title data file atit 
which is held in the WWW data 401 shown in Fig. 14. 

Each title data file contains the following: 

(a) Scenario data 20 

This includes storage location information (e.g. a 
list of file names) for the corresponding subject matter 
data, and playing information for the subject matter 
data, as described for the preceding embodiments. 25 

(c) Subject matter data 

This consists of a plurality of monomedia data files 
containing the media data contents of the hypervideo 30 
clip, as described for the preceding embodiments. 

Fig. 15 shows an example of the playing control 
table which is held in the browsing control section 1 21 of 
the information browsing section 120 of this embodi- 
ment, designated by numeral 403. This table has a sim- 35 
ilar format to the playing control table 203 of the first 
embodiment described above, shown in Fig. 4, but dif- 
fers in that the ".ref" record has been replaced by a ".tit" 
record, which relates to hypervideo title data. With this 
embodiment, when the browsing control section 121 40 
detects that a file (in actuality, a specific set of files) hav- 
ing the file extension ".tit" has been transferred from the 
WWW data service section 130 and stored in the 
acquired data storage section 122, i.e. that each of the 
component fifes of a title data file have been succes- 45 
sively read out from the WWW data storage section 
131, transferred to the information browsing section 1 20 
by using the HTTP communication system 141, and 
stored in the acquired data storage section 122, then 
the browsing control section 121 invokes a player pro- so 
gram "HV-tit-play", for playing the hypervideo data Play- 
ing of the selected hypervideo clip then begins. 

Fig. 16 shows an example of the structure of the 
WWW data which are stored in the WWW data storage 
section 131 of the WWW data service section 130 of ss 
this embodiment. In Fig. 1 6, 404 to 407 denote respec- 
tive hypertext data page units, and 408 to 413 denote 
respective monomedia data files. The monomedia data 
files 412, 413 (hvl.tit and hv2.tif) are respective title 



data files, each having the constituent data files 
described hereinabove, i.a each containing all of the 
subject matter data storage location information, sce- 
nario information, and subject matter content informa- 
tion that are necessary for playing a specif ic hypervideo 
clip. 

The basic operation sequence of this embodiment 
is unchanged from that of the prior art example 
described above. The processing sequence which is 
executed by the browsing control section 121 in the 
information browsing section 120 of this embodiment is 
similar to that of the first embodiment shown in Fig. 5 
and described above. However the operation of this 
embodiment differs with respect to the processing exe- 
cuted in step 28 of Fig. 5 by the hypervideo data playing 
section 124 (i.e. relating to the HV-tit-play program). The 
contents of that step, for this embodiment, will be 
described referring to Fig. 1 7, and are as follows: 

Step 50: The system enters a condition in which a 
selection input specifying a hypervideo clip can be 
processed. 

Step 51: If a hypervideo clip has been selected, 
then the browsing control section 121 acquires from 
the WWW data storage section 131 of the WWW 
data management section 132 (via the data com- 
munication path 140, using the HTTP communica- 
tion system 141) the set of data files which are 
collectively designated as atit. consisting of the 
scenario data file of the selected hypervideo clip 
and the monomedia data files which constitute the 
subject matter data of that clip. All of the data are 
stored in the acquired data storage section 122, 
Step 52: After executing various initialization opera- 
tions, the hypervideo data playing section 124 
begins to read out (from the acquired data storage 
section 122) the contents of the scenario data file, 
and to read out and play the data of the reference 
video clip of the selected hypervideo clip, while 
counting successive reference video frame num- 
bers. Thereafter, the loop of steps 53 to 57 is repet- 
itively executed to play the contents of the 
hypervideo clip in accordance with the scenario 
data, until the end of the scenario (corresponding to 
the final frame of the reference video clip) is 
reached or the user selects termination of playing. 
Step 53: If it is found that the end of the scenario 
has been reached or it is detected that the "termi- 
nate*' button has been selected by the user, then 
operation returns to step 22 of the processing flow 
of Fig. 5. Otherwise, operation proceeds to step 54. 
Step 54: A judgement is made as to whether, at this 
point in playing the hypervideo data, the scenario 
data require that new subject matter data are to be 
read out from the acquired data storage section 1 22 
and played. If so, step 55 is executed. If not, opera- 
tion proceeds to to step 56 

Step 55: Reading out of the monomedia data file of 
the required subject matter data from the acquired 
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data storage section 122 is started, and playing of 
the data by the hypervideo data playing section 124 
and display apparatus 11 2 is started. 
Step 56: A decision is made as to whether it is nec- 
essary to end playing of a hypervideo item. e.g. to s 
end displaying of a text or still picture item, the deci- 
sion being based on the scenario data and the ref- 
erence frame number count 
Step 57: Playing of that item is terminated, if so 
decided in step 56. Operation then returns to step 10 
34. 

The display sequence which occurs with this 
embodiment, for the case in which the WWW data and 
the monomedia data are as shown in Fig. 1 6, is identical 75 
to the sequence of the first embodiment, as shown in 
Fig. 9 and described above. 

As described in the above referring to Fig. 14, with 
the third embodiment of the invention, not only the sce- 
nario data but also the subject matter data of the hyper- 20 
video data are stored (in the WWW data storage section 
131) and accessed (i.e. by first being downloaded, then 
played) as WWW data. Thus, it is unnecessary to pro- 
vide the hypervideo data service section 150 and NFS 
communication system 142 which are used with the 25 
preceding embodiments. Instead, all data transfers to 
the information browsing section 120 are performed by 
using the HTTP communication system 141. This has 
certain advantages. Firstly, the apparatus scale is 
reduced, since the hypervideo data service section 150 30 
and the hardware and sofware necessary to implement 
the NFS communication system 142 can be omitted. 
Furthermore, file management, with regard to transfer- 
ring hypervideo data to the information browsing section 
1 20, is simplified, since all of the hypervideo data for a ss 
hypervideo clip can be handled as a single set of files 
which are handled in a unified way (i.e. as the file "c.tiT 
in Fig. 14). Thus there is greater data management and 
storage efficiency, and reduced possibility of errors 
occurring. 40 

Apart from the above points, this embodiment pro- 
vides the first basic advantage of thepreceding embod- 
iments, that is to say, a user can select playing of a 
desired hypervideo clip by "clicking" on a hyperlink 
region in a displayed hypertext page, in the conventional 45 
way However the embodiment does not provide the 
second basic advantage of the preceding embodi- 
ments, whereby there is a minimum of time delay 
between the point at which a user selects playing of a 
desired hypervideo clip and the actual start of playing of so 
the hypervideo. That is because it is necessary for the 
contents of the "c.tir file, transferred using the HTTP 
communication system 1 41 , to be stored in the acquired 
data storage section 122 before playing of the selected 
hypervideo clip can begin. 55 

A fourth embodiment of an information provider 
apparatus according to the present invention will be 
described in the following, referring first to Fig. 18, which 
is a simple system block diagram of the apparatus. In 



Fig. 18, C denotes respective ones of a plurality of client 
terminals, each of which has an identical internal config- 
uration, which are connected via a data communication 
path 140 to a server computer S. Each of the client ter- 
minals C has is configured of an I/O section 1 1 0 and an 
information browsing section 120, mutually connected 
as shown in Fig. 2 and described hereinabove. The 
server computer S is made up of a WWW data service 
section 130 and a hypervideo data service section 150, 
which are linked to the information browsing section 120 
of each of the client terminals C via a data communica- 
tion path 140 by using a HTTP communication system 
141 and NFS communication system 142 respectively, 
as shown in Fig. 2 and described above. Each I/O sec- 
tion 110, information browsing section 120, WWW data 
service section 130 and hypervideo data service sec- 
tion 150 Is configured to operate on data in a similar 
manner to that described hereinabove for the first 
embodiment, so that detailed description of these will 
be omitted. This embodiment constitutes a computer 
network, with the data communication path 140 being 
configured as a network data transmission path. 

Fig. 19 is a conceptual system block diagram for 
illustrating the connection relationships between the cli- 
ent terminals and server computer of this embodiment. 
In Fig. 1 9, each of the lines designated as N1 denotes a 
data communication connection which corresponds to 
the HTTP communication system 141 of the first 
embocfiment of the invention, shown in Fig.1 , while each 
of the fines designated as N2 denotes a data communi- 
cation connection which corresponds to the NFS com- 
munication system 142 of the first embodiment Thus, 
each of the client terminals can independently execute 
data communication with the server computer S by 
using either the HTTP communication system 141 (for 
communication with the WWW data service section 
130) or the NFS communication system 142 (for com- 
munication with the hypervideo data service section 
150). 

The basic operating sequence, with this embodi- 
ment is similar to that of the (>rior art apparatus of Fig. 
66, described hereinabove. At each of the client termi- 
nals, a user can execute input/output operations to 
acquire WWW data and hypervideo data which are 
stored in the server computer S. Playing of such 
acquired data is executed by each of the client terminals 
C independently of data input/output operations which 
are executed by the other client terminals. . 

It can thus be understood that the fourth embodi- 
ment of the invention enables the effects obtained with 
the first embodiment to be obtained for each of a plural- 
ity of client terminals. Such an arrangement can for 
example be used in teaching applications* with the vari- 
ous client terminals being used by respective students, 
and with hypervideo teaching information being stored 
and managed in a unified manner by the server compu- 
ter S, without the need to stored hypervideo data at 
each of the client terminals. 

In the above description of the fourth embodiment it 
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has been assumed that the information browsing sec- 
tion 120 of each client terminal, and the WWW data 
service section 130 and hypervideo data service sec- 
tion 150 of the server computer, are each identical in 
configuration to the corresponding sections of the first 
embodiment. However it would be equally possible to 
achieve similar results by making these sections 
respectively identical, in configuration and operation, to 
the corresponding sections of the second embodiment 
or the third embodiment of the invention, described 
above. 

A fifth embodiment of the invention will be 
described in the following, referring to Fig. 20, which is 
a simple system block diagram of this embodiment. In 
Fig. 20. C denotes respective ones of a plurality of client 
terminals which are connected via a data communica- 
tion path 140 to server computers S1 and S2. SI and 
S2. This embodiment constitutes a computer network, 
with the data communication path 140 being configured 
as a network data transmission path. Each of the client 
terminals C has the configuration described herein- 
above for the first embodiment as shown in Rg. 2, i.e. 
includes an I/O section 110 and an information brows- 
ing section 1 20. The first server computer S1 contains a 
WWW data service section 130, while the second 
server computer S2 includes a hypervideo data service 
section 150, with the I/O section 110. information 
browsing section 120, hypervideo data service section 
150 and WWW data service section 130 being respec- 
tively configured to operate on data as described here- 
inabove for the first embodiment 

The basic operation sequence executed with this 
embodiment is similar to that of the prior art apparatus 
of Fig. 66, described hereinabove. With each of the cli- 
ent terminals, a user can execute input/output opera- 
tions to acquire WWW data which are stored in the 
WWW data service section 1 30 of the server computer 
S1 (i.e. which functions as a WWW data server), and 
hypervideo data (specifically, scenario data and subject 
matter data) which are stored in the hypervideo data 
service section 150 of the server computer S2 (i.e. 
which functions as a hypervideo data server). The infor- 
mation browsing section 120 of each of the client termi- 
nals C executes data communication with the WWW 
data service section 1 30 of the server computer S1 and 
with the hypervideo data service section 150 of the 
server computer S2 independently of the information 
browsing section 120 in each of the other client termi- 
nals. 

Under certain conditions, this embodiment has 
advantages over the fourth embodiment, for the follow- 
ing reasons. With the fourth embodiment, in which there 
is only a single server computer which serves both as a 
WWW data server and a hypervideo data server, if 
there is a high frequency of WWW data transfers from 
the server computer to the client terminals, so that the 
workload imposed on the CPU of the server computer S 
is high, then this may have an adverse effect upon the 
process of transferring hypervideo data from the hyper- 



video data service section 150 to the client terminals 
(i.e. data transfer operations in which the client termi- 
nals directly access files which are stored in the hyper- 
video data service section 150). However with the fifth 

5 embodiment, since two separate server computers are 
used for handling WWW data transfer requests and 
hypervideo data file accesses from client terminals, 
respectively, that problem of CPU overload can be 
avoided, and it can be ensured that video data compo- 
rt? nents of hypervideo are correctly transferred to the cli- 
ent terminals as required; 

In the above description of the fifth embodiment it 
has been assumed that the information browsing sec- 
tion 120 of each client terminal, and the WWW data 

is service section 130 and hypervideo data service sec- 
tion 150 of the server computer, are each identical in 
configuration and operation to the corresponding sec- 
tions of the first embodiment. However it would be 
equally possible to achieve similar results by making 

20 these sections respectively identical to the correspond- 
ing sections of the second embodiment of the invention. 

A sixth embodiment of the invention will be 
described in the following, referring to Rg. 21 , which is 
a simple system block diagram of this embodiment. In 

25 Fig. 21 , C denotes respective ones of a plurality of client 
terminals which are connected via a data communica- 
tion path 140 to server computers S1 and S2. This 
embodiment also constitutes a computer network, with 
the data communication path 140 being configured as a 

30 network data transmission path. Each of the client ter- 
minals has the configuration described hereinabove for 
the first embodiment as shown in Fig. 2, i.e. includes an 
I/O section 110 and an information browsing section 
120. The server computer S1 contains a WWW data 

35 service section 1 30 and a hypervideo service section 
150a. while the second server computer S2 contains a 
hypervideo service section 150b. The I/O section 110, 
information browsing section 120 and WWW data serv- 
ice section 130 are respectively configured to operate 

40 on data as described hereinabove for the first embodi- 
ment However the hypervideo service section 150a 
stores and hancfles only those parts of the hypervideo 
data (such as scenario data, lists of subject matter data 
file names, subject matter data consisting of text data 

45 files or still picture data files) which are not of continu- 
ous data type, i.e. hypervideo data other than subject 
matter data of video clips or audio clips. The hypervideo 
service section 150b stores and handles only those 
parts of the hypervideo data which are of continuous 

50 data type, i.e. which must be transferred in a substan- 
tially continuous manner to a client terminal, when 
required. Data transfers from the hypervideo service 
section 150a or hypervideo service section 150b to the 
client terminals are performed using the NFS com muni- 

55 cation system 142, as described for the first embodi- 
ment shown in Rg. 2, so that the hypervideo service 
section 150a of the server computer SI and the hyper- 
video service section 1 50b of the server computer S2, 
in combination, perform the functions of the hypervideo 
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data service section 150 of the first embodiment. 

Thus with this embodiment, the server computer S1 
is a "discontinuous data server** which handles all man^ 
agement of storing and transferring data of the WWW 
data and those parts of the hypervideo data which are s 
not of continuous media data type, whereas the server 
computer S2 is a "continuous media data server", which 
handles all the functions of storing and transferring (i.e. 
by direct file access via the data communication path 
140) those parts of the hypervideo subject matter data 10 
which are of continuous media data type. 

The basic operation sequence executed with this 
embodiment is similar to that of the prior art apparatus 
of Fig. 66, described hereinabove. With each of the cli- 
ent terminals, a user can execute input/output opera- is 
tions to acquire WWW data or hypervideo data which 
are stored in the server computer S1 or the server com- 
puter S2. In the same way as for the fourth and fifth 
embodiments described above, such data transfer oper- 
ations are executed mutually independently by each of 20 
the client terminals. This embodiment is advantageous, 
for example, when the hypervideo subject matter con- 
tents mainly consist of continuous-type media data such 
as video or audio data, with only a small proportion of 
non-continous data such as text or graphics data. Since 25 
the server computer S2 is dedicated to handling the 
transfer of only continuous-type media data to the client 
terminals, it can be ensured that reliable transfer of such 
hypervideo data to the client terminals, without delays in 
transfer, can be achieved, irrespective of the level of 30 
load that is being imposed on the CPU of the server 
computer S1 (i.e. rf there is a large volume of WWW 
data being handled by the server computer St, for 
example). Enhanced performance in playing hypervideo 
by the client terminals can thereby be achieved. 35 

In the above description of the sixth embodiment it 
has been assumed that the information browsing sec- 
tion 120 of each client terminal, and the. WWW data 
service section 130 of the server computer S1 , are each 
identical in configuration and operation to the corre- 40 
sponding sections of the first embodiment while the 
combination of the hypervideo service section 150a and 
hypervideo service section 150b perform in combina- 
tion, the same functions as those of the hypervideo data 
service section 150 of the first embodiment Hence, the 45 
scenario reference data are stored in the WWW data 
service section 1 30, and the scenario data are stored in 
the hypervideo service section 150a. However it would 
be equally possible to achieve similar results by arrang- 
ing that, in the same way as for the second embodi- so 
ment, the scenario data are not utilized, while the 
scenario data are stored innhe WWW data service sec- 
tion 130 and are accessed in the same manner as other 
WWW data. 

With this embodiment since the server computer 55 
S2 is a dedicated server of continuous media data such 
as video data, a machine which has been hardware- 
configured for high efficiency of transferring media data 
over a network such as a LAN (local area network), and 



in particular for high efficiency of transferring video data, 
can be advantageously used as that server computer. 
Moreover, although it has been assumed that the 
embodiment uses the NFS system for transfer of hyper- 
video data between the server computer S2 and the cli- 
ent terminals, it would be equally possible to utilize a 
data communication system such as the aforemen- 
tioned VideoShower. 

A seventh embodiment of the invention will be 
described in the following, referring to Fig. 22, which is 
a simple system block diagram of this embodiment. In 
Fig. 22, C denotes respective ones of a plurality of client 
terminals which are connected via a data communica- 
tion path 140 to server computers S1 to S6. As for the 
preceding embodiment, this embodiment also consti- 
tutes a computer network, with the data communication 
path 140 being configured as a network data transmis- 
sion path. Each of the client terminals C has the config- 
uration described hereinabove for the first embodiment 
as shown in Fig. 2, i.e. includes an I/O section 110 and 
an information browsing section 120. 

This embodiment has a total of six server comput- 
ers, designated as S1 to S5 respectively. The data held 
in the server computers are as follows: 

In WWW data service section 1 30 of server compu- 
ter S1 : WWW data, i.e. hypertext data and monomedia 
data (other than hypervideo subject matter data), 
including scenario reference data. 

In hypervideo service section 1 50c of server com- 
puter S2: scenario data, 

In hypervideo service section 150d of server com- 
puter S3 : video subject matter data of hypervideo, 

In hypervideo service section I50e of server com- 
puter S4: audio subject matter data of hypervideo. 

In hypervideo service section 150f of server com- 
puter S5 : still picture subject matter data of hypervideo, 

In hypervideo service section 150g of server com- 
puter S6: text subject matter data of hypervideo. 

Thus, the server computer S1 functions as a WWW 
data server, while the server computers S2 to S6 func- 
tion as respective hypervideo subject matter data serv- 
ers. 

Each I/O section 1 10, information browsing section 
1 20 and WWW data service section 130 is configured to 
operate on data in a similar manner to that described 
hereinabove referring to the first embodiment, so that 
detailed description of these will be omitted. Each of the 
hypervideo data service sections 150c to 150g is con- 
figured to operate on data in a similar manner to that 
described for the hypervideo data service section 1 50 of 
the first embodiment, except for the fact that these 
hypervideo data service sections are dedicated to 
respectively different categories of monomedia data 
which constitute hypervideo subject matter data. With 
this embodiment, the storage location information con- 
tained in the scenario data for a hypervideo clip will also 
include, for each subject matter data file of that hyper- 
video clip, the name of the server computer where the 
file is stored. 
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The basic operation sequence executed with this 
embodiment is similar to that of the prior art apparatus 
of Fig. 66, described hereinabove. With each of the cli- 
ent terminals, a user can execute input/output opera- 
tions to acquire WWW data or hypervideo data which 
are stored in the server computers S1 to S6. In the 
samQ way as for the fourth through sixth embodiments 
described above, such data transfer operations are exe- 
cuted mutually independently by each of the client ter- 
minals. However with this embodiment, during playing 
of hypervideo by a client terminal, respectively different 
ones of the server computers S2 to S6 are accessed by 
that client terminal, to read out the contents of a sce- 
nario data file and to read out the contents of respective 
subject matter data files (i.e. video data files, text data 
files, etc.) which are specified in the scenario data. 

This embodiment is especially advantageous when 
it is necessary to store large amounts of hypervideo 
subject matter data, and when there is a high frequency 
of network accessing, since with this embodiment it is 
ensured that when any of the server computers is oper- 
ating with a high level of CPU load, that will not have any 
adverse effect upon any of the other server computers. 
Hence, stable performance with regard to playing 
hypervideo can be achieved. 

This embodiment has been described for the case 
in which respective single server computers are dedi- 
cated as servers for each of the various categories of 
hypervideo subject matter data. However it is equally 
possible to determine the number of such dedicated 
server computers in accordance with the relative pro- 
portions of amounts of data which must be stored for 
these different categories, i.e. in relation to the total 
amount of hypervideo subject matter data. For example, 
if the amount of still picture and text subject matter data 
is relatively small, then it might be preferable to use a 
single server computer which is dedicated as a server of 
that category of subject matter data Conversely, if the 
amount of video subject matter data is very large, then 
it may be preferable to use a plurality of server comput- 
ers as video data servers (i.e. storing respectively differ- 
ent files of the video subject matter- data for the 
hypervideo). In that way, the number of server comput- 
ers which function as servers of hypervideo subject 
matter data can be determined such as to match the 
characteristics of a particular network. 

Also with this embodiment, since the server com- 
puters S3 and S4 function as dedicated server of contin- 
uous media data, computer installations which have 
been specially configured for high efficiency of transfer- 
ring continuous media data over a network can be 
advantageously used as these server computers. More- 
over, although it has been assumed that the embodi- 
ment uses the NFS system for transfer of hypervideo 
data between the server computers S2 to S6 and the cli- 
ent terminals, it would be equally possible to utilize a 
data communication system such as the aforemen- 
tioned VideoShower, in particular for data transfer 
between the server computers S3, S4 and the client ter- 



minals. 

In the above description of the seventh embodiment 
it has been assumed that the information browsing sec- 
tion 120 of each client terminal, and the WWW data 
5 service section 1 30 of the server computer S1 , are each 
identical in configuration and operation to the corre- 
sponding sections of the first embodiment, while the 
combination of the WWW data service sections 150c to 
150g of the server computers S2 to S6 performs the 
10 same functions as those of the hypervideo data service 
section 150 of the first embodiment In that case, the 
scenario reference data are stored in the WWW data 
service section 130 of the server computer S1 , and the 
scenario data are stored in the hypervideo service see- 
rs tion 150c of the server computer S2. However it would 
be equally possible to achieve similar results by arrang- 
ing that, in the same way as for the second embodi- 
ment, the scenario reference data are not utilized, while 
the scenario data are stored in the WWW data service 
20 section 130 of the server computer S1 and are 
accessed by the client terminals in the same manner as 
other WWW data. 

An eighth embodiment of the invention will be 
described in the following, referring to Fig. 23, which is 
25 a simple system block diagram of this embodiment. In 
Fig. 23, numerals C1 to C3 denote respective ones of a 
plurality of client terminals which are connected via a 
data communication path 140 to a saver computer S. 
As for the preceding embodiment, this embodiment also 
30 constitutes a computer network, with the data communi- 
cation path 140 being configured as a network data 
transmission path. 

This embodiment differs from each of the preceding 
embodiments as follows. Instead of the server computer 
35 S being provided internally with both a hypervideo data 
service section 150 (formed of a hypervideo data stor- 
age section 151 and hypervideo data management sec- 
tion 1 52) and a WWW data service section 1 30 (formed 
of a WWW data storage section 131 and WWW data 
40 management section 132, as shown in Fig. 2), the 
server computer S includes only a hypervideo data 
service section 150, which stores hypervideo data (i.e. 
scenario data and subject matter data) which can be 
accessed by any of the client terminals of the network, 
45 such as client terminals C1 to C3. Each of these client 
terminals is provided internally with a WWW data serv- 
ice section, i.e. designated as 130a. 130b, 130c for the 
client terminals CI to C3 respectively in Fig. 23, while in 
addition each client terminal includes an I/O section 1 1 0 
so and an information browsing section 120. In each of 
these WWW data service sections, the WWW data stor- 
age section 131 stores WWW' data (hypertext data, 
monomedia data and scenario reference data) which 
are for use by the corresponding client terminal. In that 
55 way, each of the client terminals C1 to C2 can display a 
home page which is specific to that client terminal, i.e. 
so that a user of one of these client terminals may be 
able to access hypervideo dips (determined by the par- 
ticular scenario reference data f iles which are held in 
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the WWW data service section 130 of that client termi- 
nal) which are not available to users of other ones of the 
client terminals, for example, while some of the hyper- 
video clips (and monomedia data and hypertext data) 
may be available at any of the client terminals. § 

Each I/O section 110, information browsing section 
120 and hypervideo data service section 150 is config- 
ured to operate on data in a similar manner to that 
described hereinabove referring to the first embodi- 
ment, so that detailed description of these will be omit- 10 
ted. Each of the WWW data service sections 130c to 
130c is configured to operate on data in a similar man- 
ner to that described for the WWW data service section 
130 of the first embodiment, except for the fact that 
these WWW data service sections are dedicated to 15 
respectively different sets of WWW data, specific to the 
respective client terminals. 

The basic operation sequence executed with this 
embodiment is similar to that of the prior art apparatus 
of Fig. 66, described hereinabove. With each of the cli- 20 
ent terminals, a user can execute input/output opera- 
tions to acquire hypervideo data which are stored in the 
server computer S. In the same way as for the fourth 
through seventh embodiments described above, such 
data transfer operations are executed mutually inde- 25 
pendently by each of the client terminals. 

Such an apparatus has various advantages, in cer- 
tain types of application, such as when it is desirable to 
provide different hypervideo access capabilities for cli- 
ent terminals which are disposed in respectively differ- 30 
ent locations. In the case of a large department store for 
example, the client terminals C1. C2, C3, etc. could be 
provided on respectively different floors of the store, ft 
can thereby be arranged that each of the client termi- 
nals can play hypervideo clips which relate to the goods 35 
that are being marketed on that particular floor, but can 
also play certain hypervideo clips which are common to 
the department store as a whole,-i.e. both localized and 
general information can be provided in multimedia form, 
by each of the client terminals. That is to say, the client 40 
terminals can display respectively different menu pages 
(for hyperlink selection), from which- a user can select 
various hypervideo clips. 

Alternatively, the embodiment could be applied to 
education in which the client terminals are used as indi- 45 
vidual education terminals, by enabling each of the cli- 
ent terminals to provide information (in multimedia form) 
which is adapted to the degree of advancement of a 
particular student, i.e. again with the client terminals 
displaying respectively different menu pages, with the so 
hypervideo items that can be selected from a menu 
page being predetermined in accordance with the edu- 
cational level of the particular student. 

In the above description of the eighth embodiment 
it has been assumed that the information browsing sec- ss 
tion 120 of each client terminal is identical in operation 
and configuration to that of the first embodiment, and 
that each of the WWW data service sections 130a to 
130c of the client terminals is identical in operation and 



configuration to the WWW data service section 130 of 
the first embodiment while the hypervideo data service 
section 150 of the server computer S performs the 
same functions as those of the hypervideo data service 
section 150 of the first embodiment. In that case, the 
scenario reference data for a client terminal are stored 
in the WWW data service section (130a, 130b or 130c) 
of that client terminal, while the scenario data (i.e. all of 
the scenario data files which corresponds to the various 
scenario reference data that are stored in the WWW 
data service sections of the client terminals) are stored 
in the hypervideo data service section 150 of the server 
computer S. However it would be equally possible to 
achieve similar results by arranging that, in the same 
way as for the second embodiment, the scenario refer- 
ence data are not utilized, while the scenario data for 
the hypervideo dips that are for use by a particular cli- 
ent terminal are stored in the WWW data storage sec- 
tion 131 of the WWW data service section of that client 
terminal, i.e. to be accessed by the client terminal in the 
same way as other WWW data which are stored in that 
WWW data storage section 131. 

A ninth embodiment of the invention will be 
described in the following, referring to Fig. 24, which is 
a simple system block diagram of this embodiment. In 
Fig. 24, numerals C1 to C3 denote respective ones of a 
plurality of client terminals which are connected via a 
data communication path 140 to a server computer S. 
As for the preceding embodiment, this embodiment also 
constitutes a computer network, in which each of the clir 
ent terminals can communicate with the server compu- 
ter, and with the data communication path 140 being 
configured as a network data transmission path. 

In Fig. 24, each of the client terminals Ct to C2 con- 
tains an I/O section 110, an information browsing sec- 
tion 120, and a hypervideo service section (150h, 150i 
or 150j), while the server computer S contains a WWW 
data service section 130 and a hypervideo service sec- 
tion 150k. The configuration and operation of each I/O 
section 110, information browsing section 120 and the 
WWW data service section 130 are identical to those of 
the first embodiment described hereinabove. Each of 
the hypervideo data service sections functions in a sim- 
ilar manner to that of the hypervideo data service sec- 
tion 150 of the first embodiment. However with this 
embodiment, the hypervideo data storage section 151 
of the hypervideo service section of a client terminal 
stores hypervideo data which are for use by only that cli- 
ent terminal. In addition, the hypervideo data storage 
section 151 of the hypervideo service section 150k of 
the server computer S stores hypervideo data (scenario 
data and subject matter data) which can be accessed 
by any of the client terminals. 
To summarize: 

Data stored by each client terminal: hypervideo 
data (scenario data and subject matter data), stored in 
the hypervideo data storage section 151 of the hyper- 
video service section of that client terminal, the hyper- 
video data being for use by only that particular client 
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terminal. 

Data stored by the server computer S: 

(a) WWW data, i.e. monomedia data and hypertext 
data, the hypertext data including data of hypertext 
pages respectively corresponding to each of the cli- 
ent terminals (with each page containing hyperlinks 
to hypervideo data that are specific to a particular 
client terminal). Also scenario reference data for 
hypervideo data which are held in the server com- 
puter S and for hypervideo data which are held in 
the various client terminals. These WWW data are 
stored in the WWW data storage section 131 of the 
WWW data service section 130 of the server com- 
puter S, and are available to each of the client ter- 
minals via the data communication path 140, using 
the HTTP communication system 141 ; 

(b) hypervideo data (scenario data and subject 
matter data), stored in the hypervideo data storage 
section 151 of the hypervideo service section 150k 
of the server computer S, available in common to all 
of the client terminals, via the data communication 
path 140, by using the NFS communication system 
142. 

Thus with this embodiment, each of the client termi- 
nals (or each of a plurality of groups of client terminals) 
can store and use respectively different hypervideo data 
from that of the other client terminals, while the server 
computer S stores hypervideo data and WWW data that 
can be accessed by each of the client terminals, the 
WWW data including data expressing hyperlinks to 
hypervideo data that are specific to the various client 
terminals, as well as scenario reference data for all of 
the hypervideo data. 

Hence, with this embodiment the process of select- 
ing data to be played by any particular client terminal 
can be understood by referring again to the WWW data 
example of Fig. 7, described above for the first embodi- 
ment. In the case of the ninth embodiment, when a user 
of a client terminal selects the set of hypervideo clips, 
i.e. the hyperlink item "mvs.htmr from^he home page, 
then WWW data expressing a menu page (i.e the menu 
page "mvs.htmr in Fig. 7) containing hyperlinks to vari- 
ous hypervideo clips will be transferred from the server 
computer S to that client terminal, and displayed. That 
menu page will be specif ic to the client terminal which is 
being operated (or to a group of client terminals within 
which that client terminal is a member). The menu page 
will contain hyperlinks to hypervideo clips that are com- 
mon all of the client terminals (i.e. for which the hyper- 
video data are stored in the hypervideo service section 
150k of the server computer S) and also hyperlinks to 
• hypervideo clips which are only available at that partic- 
ular client terminal (i.e. for which the hypervideo data 
are stored within the hypervideo service section of that 
client terminal). 

The basic operation sequence executed with this 
embodiment is similar to that of the prior art apparatus 



of Fig. 66, described hereinabove. Users of each of the 
client terminals can execute input/output operations, by 
selection of displayed hyperlink data items, to acquire 
various types of data which are stored at the server 

5 computer S. Specifically, the information browsing sec- 
tion 120 of each of the client terminals C1 , C2, etc. can 
execute data communication with the WWW data serv- 
ice section 130 and the hypervideo service section 150k 
of the server computer S, and also with the hypervideo 

w service section (150h, 150i, etc.) of that client terminal 
itself. 

An information provider apparatus in accordance 
with the ninth embodiment of the invention can be 
advantageously applied to applications such as a data 

is providing network in which the client terminals function 
as customer information display terminals. That is to 
say, a server computer at the head office of a company 
can store scenario data lor hypervideo data which could 
be of interest to customers of the company in general, 

20 together with hypervideo data which relate to customers 
of the head office, while client terminals are provided at 
each of the branch offices, with each of these client ter- 
minals storing hypervideo customer information that is 
specific to that branch office. In that way, it can be 

25 arranged that each of the branch offices can only 
access customer hypervideo data relating to its own 
customers, and the head office customer hypervideo 
data, ft can thus be understood that such a system can 
be configured appropriately, in accordance with the 

30 range of hypervideo data which must be accessed by 
each of the client terminate. 

In the above description of the ninth embodiment it 
has been assumed that scenario reference data for all 
of the hypervideo data stored in the various hypervideo 

35 data service sections of the network are held in the 
WWW data service section 130 of the server computer 
S, with corresponding scenario data being held in the 
respective hypervideo data service sections of the client 
terminals C1, C2, etc. and of the server computer S, in 

40 a similar manner to that described for the first embodi- 
ment However it would be equally possible to achieve 
similar results by arranging that, in the same way as for 
the second embodiment scenario reference data are 
not utilized, and the scenario data for all of the hyper- 

45 video data are held (in the form of WWW data) in the 
WWW data service section 130 of the server computer 
S. Irrespective of which of these arrangements is used, 
it is ensured that any user of a client terminal can easily 
access those hypervideo dips which are available at 

so that particular client terminal, by selection of hyperlink 
items in a displayed hypertext page, in the same way as 
for the preceding embodiments. 

A tenth embodiment of the invention will be 
described in the following, referring to Fig. 25. which is 

55 a simple system block diagram of this embodiment. In 
Fig. 25, C designates respective ones of a plurality of 
client terminals which are connected via a data commu- 
nication path 140 to a server computer S. With this 
embodiment, the data communication path 140 is used 
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only for transferring data from the server computer S to 
the client terminals C, when necessary. 

Each of the client terminals C has the same internal 
configuration, i.e. contains an I/O section 110, an infor- 
mation browsing section 120, a WWW data service sec- s 
tion 130d and a hypervideo service section 150m. as 
shown in Fig. 25. The server computer S contains a 
WWW data service section 130e and a hypervideo 
service section 150n. The configuration and operation 
of each I/O section 110, information browsing section 10 
120 WWW data service section 130s, and hypervideo 
service section 150m are identical to those of the I/O 
section 110, information browsing section 120, WWW 
data service section 130 and hypervideo data service 
section 150 of the first embodiment described herein- 75 
above. However with this embodiment, the WWW data 
and the hypervideo data stored in the WWW data serv- 
ice section 130e and the hypervideo service section 
1 50n of the server computer S are used only as master 
versions of data which are actually accessed and used 20 
(as copy versions) within each of the client terminals. 

That is to say, the respective data held by the server 
computer and client terminals are- 
Host computer S: WWW data, including scenario 
reference data (master), hypervideo (scenario and sub- 25 
ject matter) data (master) 

Each client terminal C: WWW data, including sce- 
nario reference data (copy), hypervideo data (copy) 

Each of the client terminals C can be selectively 
connected via a switch SW as shown to the server com- 30 
puter S via the data communication path 140. The data 
communication path 140 is again in the form of a net- 
work communication path. 

With this embodiment, all of the the master WWW 
data and hypervideo data held in the server computer S 35 
are transferred via the data communication path 140 at 
appropriate intervals (e.g. periodically, or when any 
changes are made in the contents of the data stored by 
the server computer S) to be loaded into storage at 
each of the client terminals C. Typically, these data will 40 
be read out from a hard disk storage device of the 
server computer S (constituting the WWW data storage 
section 131 of the WWW data service section 130e and 
the hypervideo data storage section 151 of the hyper- 
video service section 150n) , to be written into a hard 45 
disk storage device (constituting the WWW data storage 
section 131 of the WWW data service section 130d and 
the hypervideo data storage section 151 of the hyper- 
video service section 150n) in a client terminal. There- 
after, each of the client terminals operates in the same so 
manner as described above for the first embodiment, 
with the exception that WWW data and hypervideo data 
are transferred via respective internal circuit paths of 
the client terminal (not shown in the drawing) from the 
WWW data service section 1 30d and hypervideo serv- 55 
ice section 150m to the information browsing section 
1 20 of that client terminal, rather than being transferred 
via the data communication path 140 as with the first 
embodiment. 



Alternatively, it would be possible for the server 
computer S to hold respectively different sets of master 
WWW data and hypervideo data for each of the client 
terminals, and to periodically download into a client ter- 
minal only those data which are specific to that client 
terminal, rather than to download the same data in com- 
mon to each of the client terminals. 

Transferring of WWW data and hypervideo data 
from the server computer S to be downloaded into the 
client terminals can be implemented by any of various 
types of commonly used data communication systems, 
such as the FTP (File Transfer Protocol) system, since it 
is not necessary that the hypervideo data data be trans- 
ferred at a sufficiently high speed to enable real-time 
transfer with continuous-motion display, of video data 
contents of the hypervideo data. Hence, with this 
embodiment, it is not necessary for the client terminals, 
the data communication path 140 or the server compu- 
ter to satisfy the hardware and software requirements of 
a high-speed data communication system such as the 
NFS. 

It would be possible to modify this embodiment, by 
eliminating the data communication path 140, and to 
use transportable high-capacity data storage media 
(such as CD-ROMs or removable hard disk units) to 
transfer copies of the master WWW data and hyper- 
video data from the server computer S to each of the cli- 
ent terminals. 

This embodiment would be of use in applications 
such as when a company has a number of client termi- 
nals installed at various branch offices or shops, which 
cannot be maintained continuously in an on-line con- 
nection status to a server computer at the head office of 
the company, and in particular when the client terminals 
can be connected periodically to the server computer of 
the head office via a data communication path which 
enables only a relatively low rate of data transfer. 

In the above description, it has been assumed that - 
the information browsing section 120, the WWW data 
service section 130d and the hypervideo service sec- 
tion 150m within each client terminal function in a simi- 
lar manner to the information browsing section 120, 
WWW data service section 130 and hypervideo data 
service section 150 of the first embodiment described 
above. However it would be equally possible to elimi- 
nate the use of scenario reference data, as is done with 
the second embodiment, i.e. to hold the hypervideo sce- 
nario data, as WWW data, within the WWW data serv- 
ice section 1 30d of a client terminal. 

Furthermore, the above embodiment has been 
described on the assumption that the WWW data and 
hypervideo data are handled, within each client termi- 
nal, in a similar manner to that described for the first 
embodiment However since it is not necessary to pro- 
vide respectively separate arrangements for transferring 
the WWW data and the hypervideo data (in particular, 
the hypervideo subject matter data) from storage to the 
information browsing section 120 of a client terminal of 
the tenth embodiment, as is necessary with the first 
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embodiment, the hypervideo data can be handled within 
each client terminal in the same way as described 
above for the third embodiment. That is to say, all of the 
data for a hypervideo clip can be managed in a unified 
manner, as a single large "file" of WWW data (such as 5 
"c.tit" in Fig. 14), containing the scenario data and sub- 
ject matter data of the hypervideo clip. In that case, the 
hypervideo service section 150m can be omitted from 
each client terminal. 

An eleventh embodiment of the invention will be 10 
described in the following, referring first to Fig. 26, which 
is a simple system block diagram of this embodiment. In 
Fig. 26, respective ones of a plurality of client terminals 
C are connected via a data communication path 140 to 
a server computer S. 15 

Each of the client terminals C, has an identical con- 
figuration, i.e. is formed of a an I/O section 1 10, an infor- 
mation browsing section 120, a WWW data service 
section 130 and a hypervideo service section 150p, 
while the server computer S contains hypervideo serv- 20 
ice section 150q. The configuration, interconnections 
and operation of each of the I/O section 110, informa- 
tion browsing section 120 WWW data service section 
130, are identical to those of the first embodiment 
described hereinabove. However with this embodiment, 25 
the hypervideo service section 1 50q of the server com- 
puter S holds and manages hypervideo data for com- 
plete versions of various hypervideo dips (that data 
being referred to in the following as the original hyper- 
video data), whereas the hypervideo service section 30 
150p of a client terminal holds only hypervideo data for 
abstracts of the contents of the hypervideo clips whose 
data are stored at the server computer S. The term 
"abstracts" as used here is to be interpreted in a very 
broad sense. For example, although the data held irr the 35 
hypervideo service section 150q of the server computer 
S are referred to here as being hypervideo data, in 
some applications the subject matter data of the hyper- 
video may consist only of video data. For example, the 
information provider apparatus may have the function of 40 
enabling a user of a client terminal to select from a 
number of video clips or cinema films, by using hyper- 
link selection, while also enabling the user to play 
beforehand respective "abstracts" of the various films, in 
multimedia form, before selecting a complete film which 45 
is to be viewed. In that case, the server computer S may 
store only video data constituting various different cin- 
ema films, and the "abstracts" which are stored in the 
hypervideo service section 150p of each client terminal 
in that case can consist of multimedia "trailers" for these so 
cinema films, i.e. containing short abstracted portions of 
the films together with superimposed audio and text 
material. 

The basic operation sequence executed with this 
embodiment is similar to that of the prior art apparatus 55 
of Fig. 66, described hereinabove. However in this case, 
the information browsing section 120 of each client ter- 
minal may execute data communication internally with 
the WWW data service section 130 of that client termi- 



nal and with the hypervideo service section 150p of that 
client terminal, and also (via the data communication 
path 140, using the NFS communication system 142) 
with the hypervideo service section 150q of the server 
computer S. 

Thus, the types of data stored in each of the the cli- 
ent terminals and in the server computer S of this 
embodiment are as follows: 

Data stored by each client terminal: hypervideo 
data (scenario data and subject matter data), stored in 
the hypervideo data storage section 151 of the hyper- 
video service section of that client terminal, the hyper- 
video data expressing various "abstracts" as described 
above, and 

WWW data (including hypertext pages having 
hyperlinks to original hypervideo clips, such as com- 
plete films, which are stored in the server computer S, 
and hyperlinks to hypervideo data "abstracts" stored in 
the hypervideo service section 150p of that client termi- 
nal, and also including scenario reference data for these 
hypervideo data "abstracts). 

Data stored by the server computer S: original 
hypervideo data (scenario data and subject matter 
data), stored in the hypervideo service section 150q, 
such as hypervideo data expressing respective com- 
plete cinema films, for example. 

It can thus be understood that this embodiment 
enables an information provider apparatus to be real- 
ized in which each of a plurality of client terminals stores 
hypervideo data for a number of relatively small-scale 
hypervideo clips, which constitute "abstract" information 
that relates to corresponding large-scale hypervideo 
clips whose data are stored at a server computer, and in 
which a user of any of the client terminals can first select 
and play any desired "abstract" hypervideo dip by 
selecting the appropriate hyperlink from a displayed 
menu selection page of hypertext data, can use the 
"abstract" information thus provided to search for, or to 
obtain information concerning, a particular original 
hypervideo clip, and can then select and play (again 
using hyperlink selection from a hypertext menu page) 
the desired original hypervideo clip, which is stored at 
the server computer, ft is therefore only necessary for 
each of the client terminals to store and manage rela- 
tively small amounts of data, while storage and manag- 
ing of large amounts of hypervideo data, e.g. using 
high-capacity hard disk storage, can be centralized at a 
server computer. 

As mentioned above, this embodiment can be used 
in an application in which cinema films, stored in video 
data form at the server computer S, can be selected to 
be viewed by a user of any of the client terminals C, with 
"abstract" hypervideo clips relating to the cinema films 
being stored at each of the client terminals. However the 
embodiment could also be used in other applications, 
for example in which the hypervideo "abstract" informa- 
tion consists of news digest information, and the original 
hypervideo data represents corresponding complete 
news programs. Alternatively, the hypervideo "abstract" 
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information might consist of television program sum- 
mary information, with the original hypervideo data rep- 
resenting corresponding complete pre-recorded 
television programs. Another possibility is for the hyper- 
video "abstract" information to consist of catalog infor- 5 
mation relating to commercial products, with the original 
hypervideo data representing user manual information 
for the products. It can thus be understood that this 
embodiment has a wide range of possible applications. 

It will be understood that if the hypervideo data 10 
stored at the server computer represent only complete 
cinema films, then it will in general be unnecessary to 
specify such parameters as display screen position, 
size of the display picture, times of starting and ending 
playing, etc., for each hypervideo clip, since these may is 
be inherently predetermined. Hence, the necessary 
amount of scenario data in such hypervideo data will be 
negligible. 

In the above description of the eleventh embodi- 
ment it has been assumed that the information browsing 20 
section 120, WWW data service section 130, and 
hypervideo service section 1 50p of each of each client 
terminal is identical in configuration and operation to the 
corresponding sections of the first embodiment, i.e. that 
the WWW data held in the WWW data service section 25 
1 30 of a client terminal includes hypertext page informa- 
tion containing hyperlinks to scenario reference data for 
hypervideo data held in that client terminal and the 
hypervideo data which are held in the server computer 
S. In that case, the scenario reference data are held in 30 
the WWW data service section 130 of each client termi- 
nal, while the scenario data are stored in the hypervideo 
service section 150p of each client terminal and in the 
hypervideo service section 150q of the server computer 
S. However it would be equally possible to achieve sim- 35 
ilar results by arranging that, in the same way as for the 
second embodiment, the scenario reference data are 
not utilized, while the scenario data are stored in the 
WWW data service section 130 of each client terminal 
and are accessed (directly; from hyperlinks) in the same 40 
manner as other WWW data. 

A twelfth embodiment of the- invention will be 
described in the following, referring first to Fig. 27A, 
which is a simple system block diagram for illustrating 
the basic concepts of this embodiment. In Fig. 27A, 110 45 
denotes an I/O section, 120 denotes an information 
browsing section, 140 denotes a data communication 
path. 130 denotes a WWW data service section, and 
150 denotes a hypervideo data service section, with 
each of these having essentially identical configurations so 
and operating relationships to the corresponding sec- 
tions of the first embodiment. This embodiment further 
includes a hypervideo message posting processing 
section 160, which contains a notice board page updat- 
ing processing section 1 63, a hypervideo message data ss 
distribution section 162 and a hypervideo message 
input processing section 161. With this embodiment, 
messages which are in the form of respective hyper- 
video clips can be registered (i.e. by storing the sce- 



nario data and subject matter data of the message in 
the hypervideo data service section 150 and storing the 
corresponding scenario reference data in the WWW 
data service section 130), with respective hyperlinks 
from a specific hypertext page which is stored in the 
WWW data service section 130 (i.e. within the WWW 
data storage section 131). Such a hypertext page is 
referred to in the following as a "notice board" page. 
There may a be a plurality of such notice board pages 
stored in the WWW data service section 130, with each 
of these being connected by hyperlink to the home page 
(described hereinabove with respect to the first embod- 
iment). In that way, a user of the I/O section 110 can 
select a specific notice board page (from the home 
page), and can then select a desired hypervideo mes- 
sage to be played by the display apparatus 112, from 
that notice board page. 

The function of the hypervideo message input 
processing section 161 is to receive and temporarily 
hold the data of a hypervideo message which is to be 
posted on a notice board page, supplied from hyper- 
video message sources, and to execute any necessary 
input processing of the data. Various types of apparatus 
could be used to generate the hypervideo message 
data by a user, so that specific description of the hyper- 
video message sources will be omitted. However in 
general the message data will be transferred to the 
hypervideo message posting processing section 160 
via the same physical communication path (140) which 
is used for data browsing, as described hereinabove; 
The hypervideo message data, arranged in a format 
described hereinafter, are supplied to the hypervideo 
message data distribution section 162, which has the 
function of transferring the scenario data and subject 
matter data of the hypervideo message to the hyper- 
video data management section 1 52 of the hypervideo 
data service section 150, to be stored in the hypervideo 
data storage section 151, and receiving from the hyper- 
video data management section 152 information which 
specifies the locations where the scenario data and 
subject matter data have been stored (ag. file name 
and directory path information, for the scenario data file 
and subject matter data files which constitute the hyper- 
video message). The function of the notice board page 
updating processing section 163 is to transfer that stor- 
age location information to the WWW data service sec- 
tion 130, in such a way that a scenario reference data 
file corresponding to the stored hypervideo data of the 
message is stored in the WWW data storage section 
131 , and is connected by hyperlink to a specific one of 
the notice board pages. 

The above can be understood more clearly by refer- 
ring first to Fig. 28, which shows the data structure of a 
hypervideo message 501, i.e. as supplied to the hyper- 
video message data distribution section 1 62. As shown, 
the message data 501 contains the following: 

Notice board name: this is the name of a notice 
board page (as defined above) having an embedded 
hyperlink to this hypervideo message. 
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Message theme: this indicates the nature of the 
contents of the message. 

Message contents: this is the actual message infor- 
mation, in the form of hyper video data, i.e. consisting of 
scenario data and subject matter data. s 

It can thus be understood that all of the information 
shown in Fig. 28 must be supplied to the hypervideo 
message data distribution section 161 of the hypervideo 
message posting processing section 160, in order to 
post a new message on a notice board. 10 

The basic operation of an information provider 
apparatus according to this embodiment will be 
described in the following. When a new hypervideo 
message is to be posted on a notice board page, when 
the corresponding message data (containing the infer- is 
mation shown in Rg. 28) are received by the hypervideo 
message posting processing section 160, then as 
described above the hypervideo data (scenario data 
and subject matter data) are transferred by the hyper- 
video message data distrtoution section 162 to be 20 
stored in the hypervideo data storage section 1 51 of the 
hypervideo data service section 1 50, while scenario ref- 
erence data expressing the storage location of the cor- 
responding scenario data in the hypervideo data 
storage section 151 are generated and stored by the 25 
notice board page updating processing section 163 in 
the WWW data storage section 131 of the WWW data 
service section 130, linked to a notice board page in 
conjunction with the message theme information. 
Thereafter, a user of the I/O section 110 can select and 30 
play that hypervideo message by first selecting the cor- 
responding notice board page (such as "New Products 
Guide" in the example of Rg. 28), then selecting the 
message (i.e. by specifying the message theme, such 
as "29 inch Wide-Screen Television Receiver" in the 35 
example of Fig. 28). That selection procedure, to play a 
desired hypervideo message, is identical to that 
described above for the first embodiment for selecting a 
desired hypervideo item to be played. 

Thus with the information provider apparatus of this 40 
embodiment, the basic operation sequence of the I/O 
section 110, the information browsing section 120, the 
WWW data service section 130, the data communica- 
tion path 140 and the hypervideo data service section 
1 50 is similar to that of the information provider appara- 45 
tus of the first embodiment, and the display operation 
examples which have been provided for the f irst embod- 
iment are also applicable to this embodiment 

Rg. 27B is a block system diagram corresponding 
to the apparatus of Fig. 27A, for illustrating how this so 
embodiment can be applied to a host/server network 
which consists of a single host computer S that is cou- 
pled via a data communication path 140 to a plurality of 
client terminals C. In this embodiment, each of the client 
terminals C is made up of a I/O section 1 10, an informa- ss 
tion browsing section 120, and a hypervideo message 
generating section 165, which are connected as shown 
to to send/receive data via the data communication path 
140 to/from the server computer S. The term "hyper- 



video message generating section" is used to refer to a 
combination of devices which can be used to generate 
a hypervideo message. Since various arrangements for 
implementing the hypervideo message generating sec- 
tion could readily be envisaged by a skilled person, spe- 
cific details will be omitted herein. The server computer 
S is made up of a WWW data service section 130, a 
hypervideo data service section 130 and a hypervideo 
message posting processing section 160, configured as 
shown in Rg.27A and described hereinabove. 

The processing sequence executed by the hyper- 
video message posting processing section 160 of this 
embodiment will be described in the following, referring 
to Rg. 29, which shows the basic sequence that is exe- 
cuted to register the hypervideo message example of 
Rg. 28. as: 

Step 61 : a request is received by the hypervideo 
message input processing section 161 , to register a 
new hypervideo message. 

Step 62: the hypervideo message data distribution 
section 1 62 stores the "message content" data part 
of the received message data, in the hypervideo 
data service section 150. 

Step 63: the notice board page updating processing 
section 163 updates the WWW data which are held 
in the WWW data service section 130, in accord- 
ance with the storage locations of the "message 
content" data in the data storage section 151 and in 
accordance with the contents of the "notice board 
name" and "message theme", to thereby register in 
section 130 a new scenario reference file corre- 
sponding to the stored "message content" hyper- 
video data, with that scenario data file being 
connected by hyperlink to a specific notice board 
page, i.e. the page whose "notice board name" is 
specified in the hypervideo message data that were 
supplied to the hypervideo message input process- 
ing section 161. 

Rg. 30 shows examples of WWW data and hyper- 
video data, designated as 502 and 503, which are 
stored in the WWW data storage section 131 of the 
WWW data service section 130 and in the hypervideo 
data storage section 1 51 of the hypervideo data service 
section 150, respectively. Rg. 31 is a corresponding dia- 
gram showing how these data are changed when a 
hypervideo message such as the example of Rg. 28 is 
newly registered. The WWW data 502 consist of a 
notice board summary data page 504, having embed- 
ded hyperlinks to two notice board pages 505 and 506, 
and with the notice board page 505 having an embed- 
ded hyperlink to a scenario reference file 507. The 
hypervideo data corresponding to the scenario refer- 
ence file 507 are designated as scenario data 508 and 
subject matter data 509. Thus in the initial condition 
shown in Rg. 30, the (new.html) notice board page 
"New Products Guide" has a link to one hypervideo 
message, with the theme of that message being 
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"Pocket-size phone**. After the message shown in Fig. 
28 has been received by the hypervideo message post- 
ing processing section 160 and processed as described 
above, then as shown in Fig. 31, a hyperlink for the 
hypervideo message having the theme n 29-inch Wide $ 
TV" is inserted into the (new. htm!) notice board page 
505, i.e. a hyperlink to to a scenario reference file 507A 
(having the file name H 29tv.rer) which has been estab- 
lished for the new message. The hypervideo data (sce- 
nario data 508A and subject matter data 509A) for that 10 
new message are stored in the hypervideo data storage 
section 151 of the hypervideo data service section 150. 
with the scenario data file assigned the file name 
H 29tv.scT. 

It will be clear that this embodiment can be used in is 
a network to provide the notice board information to all 
of the client terminals of the network, i.e. with the hyper- 
video messages of a notice board being available to 
users of each of the client terminals C in the same way 
as hypervideo clips stored at the server computer of the 20 
fourth embodiment shown in Fig. 18 and described 
hereinabove, can be selectively accessed by users of 
the client terminals, by the usual browsing operations. 

Although it has been assumed in the above 
description of the twelfth embodiment that scenario 25 
data and hypervideo data are stored and used in the 
same manner as described for the first embodiment, it 
would be equally possible to eliminate the scenario ref- 
erence data, as described for the second embodiment, 
or to configure the apparatus as described for the third 30 
embodiment, i.e. storing the hypervideo subject matter 
data as part of the WWW data in the WWW data service 
section* 130. 

Embodiments of the invention will be described in 
the following, whereby hypervideo mail can be 35 
exchanged between client terminals of a network, i.e. 
whereby a client terminal can generate hypervideo mail 
data arid can send hypervideo mail via the network to 
one or more other client terminals of the network. Firstly, 
a thirteenth embodiment will be described, which is a 40 
hypervideo mail client/server network having a single 
dedicated hypervideo mail server computer. The basic 
concepts of this embodiment will be described referring 
to Fig. 32. In Fig. 32, the contents and functions of the 
I/O section 1 10, information browsing section 120, data 45 
communication path 140, WWW data service section 
130 and hypervideo data service section 150 are 
respectively substantially identical to those of the first 
embodiment shown in Fig. 2 and described herein- 
above, so that further description will be omitted. How- so 
ever the embodiment further includes a hypervideo mail 
processing section 170, which is coupled to receive 
hypervideo mail from a plurality of sources (specifically, 
respective client terminals as described hereinafter). 
The hypervideo mail is generated and sent in data sets, ss 
each having the format designated by numeral 601 in 
Fig. 33, which will be referred to as hypervideo mail 
items. As shown, the data contents include the name of 
the destination (in general, a name of a client terminal 



user) which is assumed in this example to be user "b\ 
the subject of the mail item, and the actual hypervideo 
data of the mail, i.e. scenario data and subject matter 
data, which are constituted as described hereinabove 
for the preceding embodiments. 

In Fig. 32, the hypervideo mail processing section 
170 is formed of a temporary mail storage section 171 
and an incoming mail distribution processing section 
172. When a hypervideo mail item is received, the data 
are stored temporarily in the temporary mail storage 
section 171, and examined by the incoming mail distri- 
bution processing section 172, to determine the desti- 
nation of that item. The hypervideo mail item is then 
transferred to the hypervideo data service section 150, 
and stored in the hypervideo data storage section 151. 
The incoming mail distribution processing section 172 
then updates the contents of specific WWW data held in 
the WWW data service section 130 (i.e. mail page data, 
as described hereinafter), in accordance with the desti- 
nation and subject contents of the mail item and the 
storage location of the item within the hypervideo data 
storage section 151 (i.e. the directory path information 
for the stored item). 

Fig. 34 is a simple system block diagram showing 
the respective configurations of a client terminal and the 
hypervideo mail server computer of this embodiment In 
addition to an I/O section 110 and information browsing 
section 1 20, the client terminal is provided with a hyper- 
video mail generating section 180. which can be con- 
trolled by a user to generate desired hypervideo mail 
items. The hypervideo mail server computer is assumed 
to include a WWW data service section 130, a hyper- 
video data service section 150 and a hypervideo mail 
processing section 1 70. This embodiment can for exam- 
ple be a LAN (Local Area Network), in which the data 
communication path 140 between client and server 
units of the network has a sufficiently wide bandwidth to 
permit real-time transfer of video data (e.g. using the 
NFS communication protocol) as described for the pre- 
ceding embodiments. Hypervideo mail items are sent 
via the data communication path 140 to the hypervideo 
mail server computer, to be processed in the hypervideo 
mail processing section 1 70 as described above refer- 
ring to Fig. 32. 

Fig. 35 is a simple system block diagram for 
describing an example of transferring a hypervideo mail 
item from a client terminal to the server computer A of 
this embodiment, while Fig. 36 and Rg. 37 show exam- 
ples of conditions of data held in the system, before and 
after this hypervideo mail transfer. Fig. 38 is a simple 
flow diagram showing the basic operation sequence of 
the embodiment, during such a transfer, while Fig. 39 is 
a corresponding flow diagram showing the the operation 
sequence which is executed by the server computer A 
of the embodiment ft will be assumed that the hyper- 
video mail item 601 shown in Fig. 33 is generated and 
sent. Initially, the WWW data 603 stored in the WWW 
data service section 130 consist of a general mail page 
606, which is a hypertext page having the name 
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"mail.htmr and containing embedded hyperlinks to user 
pages 607, 608, named "b.htmr and "c.html" respec- 
tively, for use by two users, identified as "b" and "c" 
respectively. The user page 607 contains a hyperlink to 
a hypervideo mail item whose scenario data and sub- 5 
ject matter data are stored in data service section 150, 
as part of the data 604. The storage location information 
609 for the scenario data of this mail item (that informa- 
tion corresponding to the scenario reference data of the 
preceding embodiments) is assumed to be w 
7mail/b/001 .sci", and the mail item consists of scenario 
and subject matter data 610 and 611 (i.e. a scenario 
data file with file name "001 .sci", and one or more sub- 
ject matter data files). 

A user of the client terminal C1 then uses the hyper- is 
video mail generating section 180 to generate a new 
hypervideo mail item, whose destination is user "b". The 
generated hypervideo mail data are sent, as indicated 
by the arrow line M1 in Fig. 35, to the hypervideo mail 
server computer A, to be processed by the hypervideo 20 
mail processing section 170, and then stored in the 
hypervideo data storage section 151 of the hypervideo 
data service section 1 50 as indicated by the hatched- 
line portion 150a. The contents of the data held in the 
server computer A will therefore become as shown in 25 
Fig. 37, due to the WWW data held in the WWW data 
service section 130 being updated by the hypervideo 
mail processing section 170 as described hereinabove, 
in accordance with the destination of the hypervideo 
mail item and the storage position of that item within the 30 
hypervideo data storage section 151 of the hypervideo 
data service section 150. As a result, the mail page 607 
for user "b" now contains an additional hyperlink to stor- 
age information 609a for the scenario data file "OOS.sci" 
of the second mail item, that item having the theme 35 
"Conference visit report". The scenario data and subject 
matter data of that hypervideo mail item, stored in the 
- hypervideo data service section 150, are designated as 
61 OA, 61 1 A respectively in Fig. 37. 

Subsequently, the user "b" can access the mail 40 
page 607, from client terminal C2, and "click on" the dis- 
played item "Conference visit report", whereupon the 
data contents of the corresponding hypervideo mail 
item will begin to be transferred to the client terminal C2 
as indicated by arrow line M2 in Fig. 35, with the subject 4S 
matter data 611 A being played by that terminal in 
accordance with the contents of the scenario data 61 OA 
in the same way as described for the first embodiment 
hereinabove- 

It can thus be understood that with this embodi- so 
ment, any user of a network such as a LAN can gener- 
ate hypervideo mail that can be sent to one or more 
other users of the network, with each of the users being 
able to access their hypervideo mail by browsing opera- 
tion as for conventional electronic mail, for example by ss 
executing "click" selection operations using an input 
device such as a mouse, while observing displayed 
hypertext pages. The embodiment therefore extends, to 
the field of multimedia data transfer, the same advan- 



tages which are provided by conventional electronic 
mail services. 

Although the above embodiment has been 
described on the assumption that scenario reference 
data are utilized as for the first embodiment, it would be 
equally possible to omit the use of scenario reference 
data and use hyperlinks directly to the scenario data, as 
with the second embodiment In that case, for example, 
the scenario data file 610 in Fig. 36 would be stored as 
WWW data in server computer A, in place of scenario 
reference data 609. Alternatively, the embodiment could 
store and manage each hypervideo mail item as WWW 
data, as for the third embodiment. 

A fourteenth embodiment of the invention will be 
described, which is a network formed of a plurality of 
hypervideo mail client/server networks. These will be 
assumed to be respective LANs (local area networks) 
each having a single dedicated hypervideo mail server 
computer. The basic concepts of this embodiment will 
be described referring to Fig. 40. In Fig. 40, the contents 
and functions of the I/O section 110, information brows- 
ing section 120. data communication path 140. WWW 
data service section 130 and hypervideo data service 
section 150 are respectively substantially identical to 
those of the first embodiment shown in Fig. 2 and 
described hereinabove, so that further description will 
be omitted. However the embodiment further includes a 
hypervideo mail processing section 170, which is cou- 
pled to receive hypervideo mail from a plurality of 
sources as described for the preceding embodiment, 
and a destination enquiry management section 179. 
The destination enquiry management section 1 79 con- 
sists of a mail destination information enquiry process- 
ing section 177 and a mail destination information table 
section 178, with the mail destination information 
enquiry processing section 177 receiving mail destina- 
tion enquiries from a plurality of sources (specifically, 
respective client terminals as described hereinafter). 

The mail destination information table section 178 
stores a mail destination information table, such as the 
example 612 shown in Fig. 41. The table is used with a 
specific hypervideo mail server computer, i.a a local 
server computer, which is assumed to have the name 
"A" assigned, and that name is specified in a "server 
name" field of the table. The remainder of the table is a 
list of mail transmission destinations, which relates each 
of a plurality of hypervideo mail destinations (e.g. 
respective users) designated by respective names, to 
corresponding hypervideo mail server computers. 

Fig. 42 is a simple system block diagram showing 
the respective configurations of a client terminal and the 
corresponding hypervideo mail server computer of a 
LAN of this embodiment. In addition to a I/O section 110 
and information browsing section 120, the client termi- 
nal is provided with a hypervideo mail generating sec- 
tion 180, which can be controlled by a user to generate 
desired hypervideo mail items. The hypervideo mail 
server computer is assumed to include a WWW data 
service section 130, a hypervideo data service section 
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150, a hypervideo mail processing section 170, and 
also a destination enquiry management section 179. In 
the same way as for the preceding embodiment, the 
data communication path 140 between the client termi- 
nal and server computer has a sufficiently wide band- 5 
width to permit real-time transfer of video data (e.g. 
using the NFS communication protocol). Hypervideo 
mail, items are sent via the data communication path 
140 to the hypervideo mail server computer, to be proc- 
essed in the hypervideo mail processing section 170 as w 
described hereinabove referring to Fig. 32. The format 
of each hypervideo mail item can for example be as 
shown in Fig. 33 and described above. An inter-network 
data communication path 194 connects the data com- 
munication path 140 of the LAN to those of other LANs, 15 
to permit interchange of data between LANs. In the 
same way as for the data communication path 140, the 
inter-network data communication path 194 has a suffi- 
ciently wide bandwidth to enable real-time transfer of 
video data with resultant continuous-motion display of 20 
the data contents. 

Fig. 43 shows the general configuration of this 
embodiment. This consists of two or more LANs, such 
as the networks N A and N B , with the client terminals 
(e g. CA1 f CA2, CA3) of a LAN being coupled via a 25 
wide-band data communication path 140 to the hyper- 
video mail server computer of that LAN (e.g. computer 
A) and also to each of the other LANs of the system, 
such as the LAN N B . 

Fig. 44 is a conceptual diagram (corresponding to 30 
Fig. 43) for illustrating the flow of data when hypervideo 
mail is sent between the client terminals CA1 and CB1 
of the LANs N A , N B of Fig. 43. In Fig. 44, each of the 
arrow lines HM S indicates a path over which hypervideo 
mail data can be sent from a client terminal to a hyper- 35 
video mail server computer, while each of the arrow 
lines HM R indicates a path over which hypervideo mail 
data can be sent from a hypervideo mail server compu- 
ter to a client terminal (i.e. when a user of the client ter- 
minal requests that a hypervideo mail item be played). It 40 
can be understood from Fig. 44 that each client terminal 
in a LAN will access only the dedicated hypervideo mail 
server computer of that LAN, when a hypervideo mail 
item addressed to a user of that client terminal is to be 
played, irrespective of whether the hypervideo mail item 45 
has originated from a client terminal within that LAN or 
within some other LAN of the system. 

Fig. 45 is a diagram for illustrating the operation of 
this embodiment, assuming the specific example that a 
user of the client terminal CA1 of LAN N A shown in Fig. 50 
44 is to send a hypervideo mail item Hm to a user tT of 
the client terminal CB1 of LAN N B . Fig. 46 is a corre- 
sponding flow diagram, showing the overall operating 
sequence which occurs during this transfer of mail, 
while Fig. 47A shows the operating sequence executed 55 
by the hypervideo mail processing section 1 70 of the 
mail server H A , and Fig. 47B shows the corresponding 
operating sequence executed by the destination enquiry 
management section 179 of that mail server H A . In Fig-. 



45, the client terminal CA1 first accesses the destina- 
tion enquiry management section 179 of hypervideo 
mail server computer A, via the data communication 
path 140, as indicated by arrow line E1, to obtain infor- 
mation (i.e. the server name) identifying the hypervideo 
mail server computer of the LAN which contains the cli- 
ent terminal that has been designated as being used by 
user "b H . That information is then sent back to client ter- 
minal CA1 , as indicated by arrow line E2. The client ter- 
minal CA1 then sends the hypervideo mail item, via the 
data communication path 140 as indicated by the arrow 
line M1, to the mail server B, to be processed by the 
hypervideo mail processing section 170 and stored in 
the hypervideo data service section 150 of that mail 
server, as indicated by the hatched-line portion 150a, 
and with the WWW data in the WWW data service sec- 
tion 130 being updated accordingly as described above. 

Subsequently, when the user "b" of client terminal 
GB1 accesses his mail page, and so finds that the 
hypervideo mail item Hm is waiting for him, the user can 
initiate playing of the hypervideo data as described for 
the preceding embodiments, with data then being trans- 
ferred via the data communication path 140 as indicated 
by the arrow line M2. 

In other respects, the operation of this embodiment 
is identical to that of the preceding embodiment. 

Furthermore, although it has been assumed that 
the fourteenth embodiment described above utilizes 
scenario reference data, as for the first embodiment, it 
would be equally possible to omit the scenario refer- 
ence data and configure each mail server computer to 
store the scenario data of a received hypervideo mail 
item as WWW data, as for the second embodiment. 
Alternatively, all mail item data could be stored and 
managed as WWW data, as for the third embodiment. 

Although this embodiment has been described in 
the above on the assumption that a system configured 
of a plurality of mutually communicating LANs is used, 
the embodiment would of course be equally applicable 
to a single LAN in which more than one dedicated 
hypervideo mail server computer is provided, i.e. with 
each server computer providing WWW data for a spe- 
cific set of client terminals of the network: Such a sys- 
tem might be necessary for example, when the number 
of client terminals in the LAN is large and there is a 
practical upper limit to the number of client terminals 
which can be handled by a single hypervideo mail 
Server computer. 

It can thus be understood that with this embodi- 
ment, when applied to a plurality of mutually communi- 
cating LANs, any user of a client terminal in a LAN can 
generate hypervideo mail which is destined for a user of 
a client terminal within the same LAN or for a user of a 
client terminal within a different LAN of the system. In 
the same way as for the preceding embodiment, each of 
the users is able to access hypervideo mail which has 
been addressed to them* in a similar manner to that of 
conventional electronic mail. 

A fifteenth embodiment of the invention will be 
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described. As for the preceding embodiment, this is a 
network formed of a plurality of mutually communicating 
hypervideo mail client/server networks (which will be 
assumed in the following to be respective LANs) each 
having a single dedicated hypervideo mail server com- 
puter. The basic concepts of this embodiment will be 
described referring to Fig. 48. In Fig. 48, the contents 
and functions of the I/O section 110, information brows- 
ing section 120, data communication path 140, WWW 
data service section 130 and hypervideo data service 
section 150 are respectively substantially identical to 
those of the first embodiment shown in Fig. 2 and 
described hereinabove, so that further description will 
be omitted- This embodiment includes a hypervideo 
mail processing section 190, formed of a temporary 
mail storage section 191, incoming/outgoing mail distri- 
bution processing section 192 and mail destination 
information table section 193. The incoming/outgoing 
mail distribution processing section 192 is coupled to 
receive and process hypervideo data from various 
sources (specifically, client terminals as described here- 
inafter), and also to receive and generate reference mail 
(described hereinafter). The temporary mail storage 
section 191 is used to temporarily hold received hyper- 
video mail and reference mail data, while these are 
examined by the temporary mail storage section 191. 
The mail destination information table section 193 holds 
a mail destination information table, which provides sim- 
ilar information to that of the mail destination information 
table of the mail destination information enquiry 
processing section 177 of the preceding embodiment 
i.e. a table which can have the data configuration shown 
in Fig. 41 , to relate the name of each registered user of 
the system to the name of the mail server computer of 
the LAN which contains the client terminal employed by 
the user. 

The data configuration of a hypervideo mail item 
can be identical to that of the thirteenth and fourteenth 
embodiments, i.e. as indicated by numeral 603 in Fig. 
49. The data configuration of a reference mail item, cor- 
responding to the hypervideo mail item 603, can be as 
designated by numeral 604 in Fig. 49. :As shown, this 
contains fields which respectively specify: 

(a) the destination of the hypervideo mail item (in 
this example, the user name "b"), 

(b) the subject of the mail item, 

(c) the name of the local server computer for the 
originating client terminal (i.e. the dedicated hyper- 
video mail server computer that provides WWW 
data to the client terminal which originates the mail 
Hem) and 

(d) information specifying the storage location of 
the mail item in the hypervideo data service section 
150 of that local server computer 

Fig. 54 is a simple system block diagram showing 
the respective configurations of a client terminal and the 
corresponding hypervideo mail server computer of a 



LAN of this embodiment In addition to a I/O section 110 
and information browsing section 120, the client termi- 
nal is provided with a hypervideo mail generating sec- 
tion 1 80, which can be controlled by a user to generate 

5 desired hypervideo mail items. The hypervideo mail 
server computer is assumed to include a WWW data 
service section 130, a hypervideo data service section 
150, and a hypervideo mail processing section 190. A 
wide-band inter-network data communication path 194' 

w connects the data communication path 140 of the LAN 
to those of other LANs, as for the preceding embodi- 
ment. However in this case, the data communication 
path 194' has a sufficiently wide bandwidth to enable 
real-time transfer of video data with resultant continu- 
es ous-motion display of the data contents, i.e. is also a 
wide-band data communication path, in the same way 
as for the data communication path 140. 

The basic physical configuration of this embodi- 
ment is as illustrated in Fig. 43 and described herein- 

20 above for the preceding embodiment, i.e. consisting of a 
plurality of mutually communicating LANs, intercon- 
nected by data communication paths having a transmis- 
sion bandwidth which is sufficiently wide to permit real- 
time transfer of video data from a server computer to a 

25 client terminal while the data are being displayed at the 
client terminal: 

Fig. 50 is a conceptual diagram (corresponding to 
Fig. 43) for illustrating the flow of data when hypervideo 
mail is sent between the client terminals CA1 and CB1 

30 of the LANs N A , N B of Fig. 43. In Fig. 44, each of the 
arrow lines HM S indicates a path over which hypervideo 
mail data can be sent from a client terminal to a hyper- 
video mail server computer, while each of the arrow 
lines HM R indicates a path over which hypervideo mail 

35 data can be sent from a server computer to a client ter- 
minal (i.e. when a user of the client terminal requests 
that a hypervideo mail item be played). It can be under- 
stood from Fig. 50 that this embodiment differs from the 
previous embodiment, in that each client terminal in a 

40 LAN may access either its own dedicated mail server 
computer or the mail server computer of another LAN, 
to receive mail which is addressed to a user of that cli- 
ent terminal. 

In Fig. 50, the arrow lines RM S denote flows of ref- 
45 erence mail data, between hypervideo mail server com- 
puters. 

Fig 51 is a diagram for illustrating the operation of 
this embodiment again assuming the specific example 
that a user of the client terminal CA1 of LAN N A shown 

so in Fig. 43 is to send a hypervideo mail item Hm to a user 
tf of the client terminal CB1 of LAN N B . Fig. 56 is a cor- 
responding flow diagram, showing the overall operating 
sequence which occurs during this transfer of mail. Fig. 
52 shows a data condition of server computers in the 

55 system prior to this mail transfer operation, while Fig. 53 
shows the corresponding condition after the hypervideo 
mail item has been set in a state in which it can be 
played by the destined user. Fig. 55 shows the operat- 
ing sequence executed by a hypervideo mail processing 
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section 190 of a hypervideo mail server computer of this 
embodiment 

Referring first to Fig 51 and Fig. 52, it is assumed 
that initially the WWW data service section 130 of the 
mail server computer B (of the LAN N B ) contains the s 
WWW data 1603, while there is no hypervideo data 
stored in the hypervideo data service section 150 of the 
mail server computer A. The WWW data 1 603 stored in 
the WWW data service section 130 consist of a general 
mail page 606, which is a hypertext page having the 10 
name "mail.htmr and containing embedded hyperlinks 
to user hypertext pages 607, 608, named "b. html" and 
"c.htmr respectively, for use by two users who are 
named "b H and "c M respectively. The user page 607 con- 
tains a hyperlink to a scenario reference fOe 1609, hold- is 
ing storage location information for the scenario data file 
"001. set" which is stored in the hypervideo data service 
section 150 of a mail server computer Z (i.e. the mail 
server computer of another LAN of the system, which is 
not shown in Fig 51). as data 1604. When a user of cli- 20 
ent terminal CA1 uses the hypervideo mail generating 
section 180 of that terminal to generate the hypervideo 
mail item whose destination is user tT, then the corre- 
sponding data are transferred to the hypervideo mail 
processing section 1 90 of the mail server computer A as 25 
indicated by the arrow line M1 in Fig 51 . The hypervideo 
mail processing section 190 then processes the mail 
data, to generate a corresponding reference mail item, 
then stores the contents of the hypervideo mail item in 
the hypervideo data service section 150 of mail server 30 
computer A, as indicated by the hatched-line region 
150a, refers to the mail destination information table 
section^ 93 to find the name of the mail server computer 
of the destination LAN, and sends the reference mail 
item to that mail server computer (in this case, the mail 35 
server computer B), as indicated by the arrow line M2 in 
Fig 51 , to be processed by the hypervideo mail process- 
ing section 190 of that mail server computer. That 
hypervideo mail processing section 190 then updates 
the contents of the WWW data service section 130 of 40 
mail server computer B, as indicated by the hatched- 
line region 130b in Fig 51 . — 

Thus, as shown in Fig. 53, the WWW data 1603 
held in the mail server computer A now have been 
updated such that the mail page for user tT has a new 45 
hyperlink item, which points to the storage location of 
the scenario data file of the new mail item (i.e. in mail 
server computer A, with the internal storage location 
information 7mail/b/005.sciT). In addition, the data con- 
tents 1 605 of the hypervideo data service section 1 50 of so 
mail server computer A now contain the scenario data 
and subject matter data 61 OA, 61 1 A for the new hyper- 
video mail item. 

In this condition, if the user "b" of client terminal 
CB1 now accesses the mail item displayed as "Confer- 55 
ence visit report" on his mail page 607, (i.e. after 
accessing that user's mail page in the WWW data serv- 
ice section 130 of the mail server computer B, as indi- 
cated by the arrow line M3). the hypervideo data of that 



mail item will be accessed at mail server computer A, 
and the mail contents will begin to be transferred (as 
indicated by arrow line M4) to client terminal CB1 from 
the mail server computer A, and played 

The above process is shown in the flow diagram of 
Fig. 56, in which the reference mail item whose destina- 
tion is user **b w being designated as Rm, and the corre- 
sponding hypervideo mail item as Hm. 

As shown by the flow diagram of Hg. 55, when the 
hypervideo mail processing section 190 of a mail server 
computer of this embodiment receives a hypervideo 
mail item, the data are first stored in the temporary mail 
storage section 191, as a first step (S1). The type of 
data (i.e. hypervideo mail or reference mail) is then 
judged, in step S1 , with appropriate processing steps 
S3 to S5, or S6, then being executed by hypervideo mail 
processing section 190 in accordance with whether a 
reference mail item or a hypervideo mail item is 
received- 
It can thus be understood that with this embodi- 
ment, when a hypervideo mail item is generated and 
sent by a user within a first LAN with the destination 
being a user located within a second LAN, it is not nec- 
essary for the contents of that mail item to be immedi- 
ately transferred over the data communication path 
between the two LANs. Instead, corresponding refer- 
ence mail information is sent to the second LAN, to 
update the WWW data of the mail server computer of 
that LAN (i.e. to update the mail page data of the des- 
tined user). Thereafter, the actual contents of the mail 
item can be accessed by the destined user, when 
required, with the mail data being transferred via the 
data communication path between the two LANs. 

In the above description of the fifteenth embodi- 
ment, it has been assumed that WWW data for the cli- 
ent terminals of a LAN are held in the mail server 
computer of that LAN. However it would be equally pos- 
sible to arrange-that the WWW data are instead held in 
each of the client terminals of the LAN, in a similar man- 
ner to that described for the second embodiment here- 
inabove. 

Furthermore the three preceding embodiments 
have been described, for ease of understanding, with 
the temporary mail processing section of the hyper- 
video mail processing section being shown as a sepa- 
rate system block from the hypervideo data storage 
section 151. However in a practical apparatus, that tem- 
porary mail processing section can of course consist of 
a dedicated storage region which is defined within the 
same data storage device (in general, a high-capacity 
hard disk apparatus) which is used to implement the 
hypervideo data storage section 151. 

With the fourteenth and fifteenth embodiments of 
the invention described above, hypervideo mail can be 
sent within a network which consists of a plurality of 
sub-networks (e.g. LANs) which mutually communicate 
via a common data communication path having a suffi- 
ciently wide bandwidth to permit real-time transfer and 
display of video data, such as the data communication 
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path 140 in the example of Fig. 43 described above. 
Embodiments of the invention will be described in the 
following, whereby hypervideo mail can be exchanged 
within a network which consists of a plurality of sub-net- 
works (e.g. LANs) which mutually communicate via a 5 
data communication path which does not have a suffi- 
ciently wide bandwidth to permit real-time transfer and 
display of video data. A typical example of such a situa- 
tion, at the present time, is hypervideo mail exchange 
between client terminals of respective networks which w 
are linked via the Internet For that reason, the following 
embodiments will be described on the assumption of 
such a linkage via the Internet However it should be 
understood that the invention is not limited to such link- 
age, and is applicable to the general case of two or 15 
more wide-band networks such as LANs mutually linked 
by any form of data communication path which does not 
provide sufficient bandwidth to permit real-time transfer 
of video data such as to enable continuous-motion dis- 
play of the data contents. 20 

Fig. 57 is a general system block diagram of a six- 
teenth embodiment of the invention. The configuration 
is basically similar to that of Fig. 43 described above, 
but differs in that the respective hypervideo mail server 
computers HA, HB of the two LANs N A , N B communi- 25 
cate via a data communication path 1194 which does 
not permit data transfer at a sufficiently high rate to ena- 
ble real-time transfer/display of video data as described 
hereinabove, and which extends, at least partially, 
through a wide area network 1195 which will be so 
assumed to be the Internet. Fig. 58 is a simple system 
block diagram showing the respective configurations of 
each client terminal and the corresponding hypervideo 
mail server computer of a LAN of this embodiment. In 
addition to a I/O section 110 and information browsing 35 
section 120, the client terminal is provided with a hyper- 
video mail generating section 180, as for the preceding 
two embodiments. The hypervideo mail server compu- 
ter includes a WWW data service section 130, a hyper- 
video data service section 150, and a hypervideo mail 40 
processing section 195. In the same way as for the pre- 
ceding embodiments, the data communication path 1 40 
between the client terminal and server computer has a 
sufficiently wide bandwidth to permit real-time transfer 
of video data (e.g. using the NFS communication proto- 45 
col). Hypervideo mail items are sent via the data com- 
munication path 140 to the hypervideo mail server 
computer, to be processed in the hypervideo mail 
processing section 1 95 as described in the following. As 
shown, the hypervideo mail processing section 195 is so 
connected to communicate with the other client termi- 
nals of its LAN, via the data communication path 140, 
and also to communicate with hypervideo mail server 
computers of other LANs, via the data communication 
path 1194. 55 

The format of each hypervideo mail item can for 
example be as shown in Fig. 33 and described above. 
However when the destined user must be accessed via 
the Internet, it may be necessary for the hypervideo mail 



item to also include Internet address information relat- 
ing to that user. 

Fig. 59 shows the internal configuration of the 
hypervideo mail processing section 195. As shown, the 
hypervideo mail processing section 195 consists of a 
mail server/client information table memory section 1 96, 
a incoming/outgoing mail distribution processing sec- 
tion 197 and a temporary mail storage section 198. 

The incoming/outgoing mail distribution processing 
section 197 executes communication via the data com- 
munication path 140 and data communication path 
1194, and generates output data for updating the con- 
tents of the WWW data service section 130 and the 
hypervideo data service section 150 of that mail server 
computer, in a similar manner to that described for the 
fourteenth embodiment above. The mail server/client 
information table memory section 196 performs a basi- 
cally similar function to the mail destination information 
table section 193 of the fifteenth embodiment described 
above, i.e. storing a mail destination information table 
essentially similar to the table 612 in Fig. 41, but pro- 
vides Information (for each destination user) which 
specifies a path passing via the Internet to the hyper- 
video mail server computer of the LAN of that user. 

The basic operating sequence of this embodiment, 
from the point of generating a hypervideo mail item to 
the point at which the item becomes available to the 
destined user, is shown in the flow diagram of Fig. 60. 
which again assumes as an example that a hypervideo 
mail item Hm is sent from the client terminal GA1 of the 
LAN N A , addressed to the client terminal CB1 of LAN 
N B . in Fig. 57. This sequence occurs as follows: 

Step S1 : The hypervideo mail generating section 
180 of client terminal CA1 sends the data of hyper- 
video mail item Hm via the data communication 
path 140, eg. by using the NFS protocol, to be 
received by the hypervideo mail processing section 
195 of the mail server HA 

Step S2: The hypervideo mail processing section 
195 of mail server HA temporarily stores the hyper- 
video mail data in the temporary mail storage sec- 
tion 198, and examins the data to obtain the name 
information of the destined user (which in this case 
will also specify an Internet address), then obtains, 
from the mail server/client information table mem- 
ory section 196, path information which is neces- 
sary for sending data via the Internet to the 
hypervideo mail server computer of the LAN of the 
destined user. The mail server computer HA then 
sends the data of that mail item, by file access oper- 
ation to hypervideo mail processing section 195 of 
mail server HB 

Step S3: The hypervideo mail processing section 
195 of mail server HB temporarily stores the data of 
mail item Hm in the temporary mail storage section 
198, and examins the data to obtain the name of 
the destined user, then stores the mail data con- 
tents (i.e. scenario data and subject matter data) in 
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hypervideo data service section (150) of mail 
server HB. 

Step $4: The hypervideo mail processing section 
1 95 of mail server HB updates the WWW data (spe- 
cifically, the mail page data for user "b") held in s 
WWW service section (1 30), in accordance with the 
mail destination information contained in mail item 
Hm and the storage location of the mail contents 
within hypervideo data service section (150) of mail 
server HB. w 
Step S5: User "b", from terminal CB1 , accesses the 
genera! mail page stored at server HB, then uses 
hyperlinks to access his own mail page and then to 
select the mail item Hm to be played. The contents 
of the hypervideo mail item Hm (i.e. the scenario 75 
data and subject matter data for that mail item) then 
■ begin to be transferred via the data communication 
path 140 to the client terminal CB1, e.g. using the 
NFS communication protocol, with real-time trans- 
fer and playing of the contents of mail item Hm 20 
being thereby implemented as described herein- 
above for the first embodiment. 

A seventeenth embodiment will be described, hav- 
ing a general configuration which is similar to that of the 25 
preceding embodiment shown in Fig. 57. This embodi- 
ment differs from the preceding embodiment in that ref- 
erence mail is transmitted from the hypervideo mail 
server of the originating LAN to the hypervideo mail 
server of the destination LAN, with the reference mail so 
having a similar function to that of the fifteenth embodi- 
ment described above. The respective internal configu- 
rations 1 of each client terminal and the corresponding 
mail server of a LAN in this embodiment, as shown in 
Fig. 61, are similar to those of the preceding embodi- 35 
ment however the configuration and operation of the 
hypervideo mail processing section of this embodiment 
differs from that of the preceding embodiment That 
processing section is shown in Fig. 62, designated by 
numeral 1 1 95. As shown, the hypervideo mail process- 40 
ing section 1 195 is formed of a mail server/client infor- 
mation table memory section 196 and temporary mail 
storage section 198, which function as described for the 
preceding embodiment, together with an incoming/out- 
going mail distribution processing section 1 1 99 which is 45 
configured to send and receive hypervideo mail and ref^ 
erence mail items via the Internet, and also to receive 
hypervideo mail items from client terminals of the local 
LAN. sent via the data communication path 140. The 
received hypervideo mail are processed in the same 50 
way as described for the preceding embodiments, i.e. if 
the. mail item has as its destination a client terminal 
within the LAN of that mail server computer, the the data 
contents (scenario data and subject matter data) of a 
received hypervideo mail item are stored in the hyper- ss 
video data service section 150, with the data (i.e. of a 
user mail page) held in the WWW data service section 
130 then being updated accordingly. In addition, with 
this embodiment it is necessary for the hypervideo mail 



processing section 1 1 95 to have a capability for access- 
ing (via the Internet) hypervideo mail items which are 
stored at other mail servers. Specifically, when a user of 
a client terminal in the local LAN selects a mail item 
which is addressed to that user and is being held at the 
mail server of some other LAN, then the WWW data 
service section 130 of the local LAN sends a request 
(via line 1195a in Fig. 61) to the incoming/outgoing mail 
distribution processing section 1199, whereupon the 
incoming/outgoing mail distribution processing section 
1 199 executes a file access operation via the Internet, 
to obtain the hypervideo mail data from the other mail 
server. 

The operating sequence that is executed with this 
embodiment for the case of sending a hypervideo mail 
item Hm from a client terminal CA1 of the LAN N A to a 
user of the client terminal CB1 of the LAN N B , via the 
Internet, is shown in Rg. 63. The sequence is as fol- 
lows: 

Step-Si: The hypervideo mail generating section 
180 of client terminal CA1 sends the data of hyper- 
video mail item Hm via the data communication 
path 140, e.g. by using the NFS protocol, to be 
received by the hypervideo mail processing section 
11 95 of the mail server HA 

Step S2: The hypervideo mail processing section 
1195 of mail server HA temporarily stores the 
hypervideo mail data in the temporary mail storage 
section 198, and examines the data to obtain the 
name information of the destined user (which in this 
case will also specify an Internet address), then 
obtains, from the mail server/client information 
table memory section 196, path information which 
is necessary for sending data via the Internet to the 
hypervideo mail server computer of the LAN of the 
destined user, and stores the hypervideo mail data 
in the hypervideo data storage section 151 of the 
hypervideo data service section 150. Section 1 195 
then generates a reference mail item, based on the 
mail destination information contained in the hyper- 
video mail item and storage location of that mail 
item in the hypervideo data storage section 151. 
The data configuration of a reference mail item can 
be basically similar to that described for the fif- 
teenth embodiment, but must also include Internet 
address information for the destined user. 
Step S3: The hypervideo mail processing section 
1195 of mail server HA sends the reference mail 
item, via the Internet to the hypervideo mail 
processing section 1195 of mail server HB, which 
then updates the WWW data (specifically, mail 
page data for user "b") in the WWW data service 
section 130, in accordance with the contents of the 
reference mail item, to incorporate information 
which specifies the mail server (HA) that is is hold- 
ing the mail item, and specifies storage location 
information (i.e: directory path information) for the 
mail item within that mail server. 
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Step S4: At a subsequent time, the user "b" of client 
terminal CB1 designates (using hyperlink selection, 
processed by the WWW data service section 1 30 of 
mail server HB) that the mail item Hm is to be made 
available for playing at client terminal CB1 . When 5 
that occurs, the WWW data service section 130 of 
.server HB notifies the incoming/outgoing mail distri- 
bution processing section 1199 as described 
above, and a file access operation is executed via 
the Internet to the mail server HA, by the incom- 10 
ing/outgoing mail distribution processing section 
1 199 of server HB, to receive the data of mail item 
Hm. The received hypervideo mail data are then 
processed as for the preceding embodiment, i.e. 
with the mail contents being stored in the hyper- 75 
video data service section 150 of mail server HB 
and the WWW data service section 130 being 
updated accordingly 

Step S5: User "b" t from terminal CB1 , accesses the 
general mail page stored at server HB. then uses 
hyperlinks to access his own mail page and then to 
select the mail item Hm to be played. The contents 
of the hypervideo mail item Hm (i.e. the scenario 
data and subject matter data) then begin to be 
transferred via the data communication path 1 40 to 
the client terminal CB1, e.g. using the NFS commu- 
nication protocol, with real-time transfer and playing 
of the contents of mail item Hm being thereby exe- 
cuted as described for the first embodiment. 

In the above description, it has been assumed that 
it is necessary for a user to designate that a hypervideo 
mail item, held at a remote hypervideo mail server, is to 
be transferred via the internet to the local hypervideo 
mail server of that user, to be then available to be played 
by the user. However it would be equally possible to 
arrange that such a hypervideo mail item is automati- 
cally transferred by that local hypervideo mail server 
itself at an appropriate time, for example; during during 
night hours, when the service charges for using the 40 
Internet may be reduced by comparison with daytime 
use. 

It can thus be understood that with this embodi- 
ment, when a hypervideo mail item is generated and 
sent by a user within a first LAN with the destination 45 
being a user of a client terminal which is within a second 
LAN, it is not necessary for the contents of that mail item 
to be immediately transferred via the Internet between 
the two LANs. Instead, corresponding reference mail 
information is sent by the hypervideo mail server com- so 
puter of the first LAN to that of the second LAN, to 
update the WWW data of the mail server computer of 
the second LAN such as to indicate that the mail item is 
waiting at the mail server of the first LAN. Thereafter, 
the actual contents of the mail item can be transferred to ss 
the second LAN at a suitable time, and can then be 
played by the user to whom that hypervideo mail item 
has been addressed. 

An eighteenth embodiment of the invention will be 
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described in the following. The configuration of this 
embodiment can be similar to those of the sixteenth 
embodiment, described hereinabove referring to Fig. 
57, Fig. 58 and Fig. 59. The operating sequence will be 
described referring to the flow diagram of Fig. 64^ again 
for the example of sending a hypervideo mail item Hm 
from a client terminal CA1 of the LAN N A to a user 
named as V of the client terminal CB1 of the LAN N B , 
via the data communication path 1 194, at least part of 
which will be assumed to extend through the Internet. 

Step St: The hypervideo mail generating section 
180 of client terminal CA1 sends the data of hyper- 
video mail item Hm via the data communication 
path 140, e.g. by using the NFS protocol, to be 
received by the hypervideo mail processing section 
195 of the mail server HA 

Step S2: The hypervideo mail processing section 
195 of mail server HA temporarily stores the hyper- 
video mail data in the temporary mail storage sec- 
tion 198, and examines the data to obtain the name 
information of the destined user (which in this case 
will also specify an Internet address), then obtains, 
from the mail server/client information table mem- 
ory section 196, path information which is neces- 
sary for sending data via the Internet to the 
hypervideo mail server computer of the LAN of the 
destined user. 

Step S3: The hypervideo mail processing section of 
mail server HA then encodes the hypervideo mail 
item Hm, using MIME (Multiporpose Internet Mail 
Extensions) code, and sends the encoded data via 
the Internet, as Internet mail, to the hypervideo mail 
processing section of mail server HB, then deletes 
the data of item Hm from storage. The SMTP (Sim- 
ple Mail Transfer Protocol) can for used for this data 
transfer operation. 

Step S4: The hypervideo mail processing section of 
mail server HB receives and decodes the hyper- 
video mail item Hm, temporarily stores the decoded 
data in the temporary mail storage section 198, and 
examines the data to obtain the name of the des- 
tined user, then stores the mail data contents (i.e. 
scenario data and subject matter data) in the hyper- 
video data service section 150 of mail server HB. 
Step S5: The WWW data (specifically, the mail 
page data relating to user held in WWW serv- 
ice section 130 of mail server HB are updated in 
accordance with the mail destination information 
contained in mail item Hm and the storage location 
of the mail contents within the hypervideo data 
service section 150 of mail server HB. 
Step S6: User "b\ from terminal CB1 , accesses the 
general mail page stored at server HB, then uses 
hyperlinks to access his own mail page and then to 
select the mail item Hm to be played. The contents 
of the hypervideo mail item Hm (i.e. the scenario 
data and subject matter data for that mail item) then 
begin to be transferred via the data communication 
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path 140 to the client terminal CB1, e.g. using the 
NFS communication protocol, with real-time trans- 
fer and playing of the video data contents of mail 
item Hm being thereby executed as described for 
the first embodiment. 5 

* A nineteenth embodiment of the invention will be 
described in the following. The configuration of this 
embodiment can be similar to those of the seventeenth 
embodiment, described hereinabove referring to Fig. 10 
57, Fig. 61 and Fig. 62. The operating sequence will be 
described referring to the flow diagram of Fig. 65, again 
for the example of sending a hypervideo mail item Hm 
from a client terminal CA1 of the LAN N A to a user 
named as "b" of the client terminal CB1 of the LAN N B , 15 
via the data communication path 1 194, at least part of 
which will be assumed to extend through the Internet. 

Step S1: The hypervideo mail generating section 
, 180 of client terminal CA1 sends the data of hyper- 20 
video mail item Hm via the data communication 
path 140. e.g. by using the NFS protocol, to be 
received by the hypervideo mail processing section 
1 95 of the mail server HA 

Step S2: The hypervideo mail processing section of 25 
mail server HA temporarily stores the hypervideo 
mail data in the temporary mail storage section 198, 
and examines the data to obtain the name informa- 
tion (Internet address) of the destined user, then 
obtains, from the mail server/client information so 
table memory section 196, path information which 
is necessary for sending data via the Internet to the 
hypervideo mail server computer of the LAN of the 
destined user. The data of the mail item Hm are 
then stored in the hypervideo data storage section 35 
151 of mail server HA. The hypervideo mail 
processing section of mail server HA then gener- 
ates a reference mail item, based on the mail desti- - 
nation information contained in mail item Hm and 
the storage location of that mail item in the hyper- 40 
video data storage section 1 51 . The data configura- 
tion of a reference mail item carrbe as described for 
the seventeenth embodiment. 
Step S3 : The hypervideo mail processing section of 
mail server HA sends the reference mail item, via 45 
the Internet, to the hypervideo mail processing sec- 
tion 1 1 95 of mail server HB, which then updates the 
WWW data (specifically, mail page data for user 
■b") in the WWW data service section 130, in 
accordance with the contents of the reference mail so 
item, i.e. to specify that the mail server (HA) is is 
holding the mail item Hm, and to specify the storage 
location of the mail item within the mail server HA. 
Step S4: At a subsequent time, the user "b" of client 
terminal CB1 designates (using hyperlink selection, ss 
processed by the WWW data service section 1 30 of 
mail server HB) that the mail item Hm is to be made 
available for playing at client terminal CB1. When 
that occurs, the WWW data service section 130 of 



the mail server HB sends a notifying signal to the 
hypervideo mail processing section of that mail 
server, as described above for the seventeenth 
embodiment, which responds by sending to the 
hypervideo mail processing section of the mail 
server computer HA, via the Internet, a request to 
send the mail item Hm (using SMTP) encoded 
using MIME code. 

Step S5: The hypervideo mail processing section of 
mail server HA reads out the hypervideo mail item 
Hm from the hypervideo data service section 150, 
and encodes the data of the mail item, using MIME 
code. 

Step S6: The hypervideo mail processing section of 
mail server HA sends the encoded data of mail item 
Hm via the Internet, as Internet mail, to the hyper- 
video mail processing section of mail server HB, 
then deletes the data of item Hm from storage. The 
Simple Mail Transfer Protocol (SMTP) can for used 
for this data transfer operation. 
Step S7: The hypervideo mail processing section of 
mail server HB receives and decodes the hyper- 
video mail item Hm, temporarily stores the decoded 
data in the temporary mail storage section 1 98, and 
examines the data to obtain the name of the des- 
tined user, then stores the mail data contents (i.e. 
scenario data and subject matter data) in the hyper- 
video data service section 150 of mail server HB. 
Step S8: The WWW data (specifically the mail 
page data for user IdT) held in WWW service sec- 
tion 130 of mail server HB are updated in accord- 
ance with the mail destination information 
contained in mail item Hm and the storage location 
of the mail contents within the hypervideo data 
service section 150 of mail server HB. 
Step S9: User "b", from terminal CB1 , accesses the 
general mail page stored at server HB, then uses 
hyperlinks to access his own mail page and then to 
select the mail item Hm to be played. The contents 
of the hypervideo mail item Hm (i.e. the scenario 
data and subject matter data for that mail item) then 
begin to be transferred via the data communication 
path 140 to the client terminal CB1- e.g. using the 
NFS communication protocol, with real-time trans- 
fer and playing of the video data contents of mail 
item Hm being thereby executed as described for 
the first embodiment. 

It can thus be understood that with this embodi- 
ment, hypervideo mail can be transferred as encoded 
data between two LANs, via the Internet, in the same 
manner as conventional electronic mail, by using the 
SMTP, while in addition the transfer can be executed at 
any suitable time, after a hypervideo mail item has been 
generated at a client terminal of a LAN and stored in the 
hypervideo mail server computer of that LAN. 

With the twelfth embodiment of the invention 
described hereinabove referring to Figs. 27 to 31 . a user 
of a client terminal of a client/server network can gener- 
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ate a hypervideo message which is transferred to the 
server computer of that network, and is posted on a 
specific "notice board" hypertext page (generally 
referred to herein simply as a "notice board) that is 
stored in the WWW data service section 130 of the 
server computer, while the message contents are 
stored in the hypervideo data service section 150 of the 
server computer), with the message thereby being 
made available to users of all of the client terminals of 
the network through the usual hypertext browsing pro- 
cedure. Embodiments of the invention will be described 
in the following that are applicable to a plurality of LANs 
which are interconnected to form a wide-area network 
as described for the sixteenth embodiment of the inven- 
tion described hereinabove referring to Figs. 57 to 62 
(i.e. such as "net sites" which are interconnected by the 
Internet), whereby a message that is posted on a notice 
board of one LAN can be distributed to specific other 
LANs of the wide-area network. It will be assumed that 
the client terminals of each LAN can directly exchange 
data only with the server computer of that LAN. 
Although it will in general be assumed in the following 
that the server computers of the LANs communicate via 
the Internet, it will be understood that the basic princi- 
ples described are not limited to use with the Internet 

Firstly the basic principles of a twentieth embodi- 
ment will be described referring to the simple block dia- 
gram of Fig. 73. With this embodiment, when a 
message is received from a local source (i.e. from a 
local client terminal), the message is posted as 
described hereinabove. However in addition, that post- 
ing operation is detected by a wide-area distribution 
processing section 2180. If the message has been 
posted to a specific notice board, whose posted mes- 
sages are to be distributed to each of a predetermined 
set of remote destinations (i.e. other sites, of a wide- 
area network), then the message is transmitted to each 
of these destinations by the wide-area distribution 
processing section 2180. 

Fig. 74 is a general system block which shows this 
embodiment in greater detail. In Fig. 74 the IAD section 
110, information browsing section 120rdata communi- 
cation path 140, WWW data service section 130 and 
hypervideo data service section 150 respectively corre- 
spond to the identically numbered sections of the first 
embodiment described hereinabove referring to Fig. 2. 
In addition, the hypervideo message posting processing 
section 160 corresponds to that of the twelfth embodi- 
ment, shown in Fig. 27A and described hereinabove, 
which has the function of posting a received hypervideo 
message by storing the message contents (scenario 
data and subject matter data) in the hypervideo data 
service section 150 and registering in the WWW data 
service section 1 30 the "message theme" information of 
the message in the notice board which is specified by 
the "notice board name" information of the message, 
linked to the respective storage locations of the mes- 
sage contents in the hypervideo data service section 
150. This embodiment further includes the wide-area 



distribution processing section 2180, which has three 
basic functions, i.e.: 

(a) to detect each occurrence of a hypervideo mes- 
5 sage posting operation that is executed by the 

hypervideo message posting processing section 
160. 

(b) to determine whether that message is to be dis- 
tributed to remote destinations, i.e. to one or more 

w sites of a wide-area network (server computers of 
other LANs), 

(c) if so, to transmit the message to these other 
server computers, and 

(d) to receive data of messages that have been 
is transmitted from remote sources, i.e. from other 

server computers, to arrange the data into the 
structure of a standard hypervideo message (e.g. 
such as that shown in Fig. 28 and described herein- 
above), and to input the message to the hypervideo 
20 message posting processing section 160, to be 
thereby posted on the notice board (i.e. hypertext 
"notice board" page) which is specified in the mes- 
sage, as described hereinabove. 

25 To provide the above functions, the wide-area distri- 
bution processing section 2180 is made up of a distribu- 
tion transmitting section 2183 which performs functions 
(b) and (c) above, a distribution condition memory 21 82 
which can be accessed by the distribution transmitting 

30 section 2183, a posting result detection section 2181 
which supplies data to the distribution transmitting sec- 
tion 2183, to perform function (a) above, and a distrib- 
uted message receiving section 2184 which receives 
hypervideo message data supplied from remote 

35 sources (i.e. other server computers) to perform func- 
tion (d) above. The distributed message receiving sec- 
tion 2184 includes a memory section for temporarily 
storing the data of a distributed hypervideo message as 
they are received, before transferring the entire data of 

40 the message (arranged in the standard hypvervideo 
message format) to the hypervideo message posting 
processing section 160. 

As shown, the hypervideo message input process- 
ing section 161 of the hypervideo message posting 

45 processing section 160 receives hypervideo message 
data (in standardized format) supplied from either the 
distributed message receiving section 2184 or from 
local sources (i.e. from client terminals of the local net- 
work). 

so Specifically, the distribution condition memory 2182 
stores the names of each of the notice boards for which 
messages are to be distributed to other server comput- 
ers, and the names of these other server computers. 
The posting result detection section 2181 monitors the 

55 operation of the hypervideo message data distribution 
section 162, to detect each message posting operation 
and the name of the notice board on which the message 
has been posted, and supplies the notice board name 
information to the distribution transmitting section 2183, 
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which thereby uses the information stored in the distri- 
bution condition memory 2182 to determine whether 
that message is to be distrubuted to other server com- 
puters. If the message is to be distributed, the distribu- 
tion transmitting section 2183 then obtains via the s 
posting result detection section 2181 the remaining con- 
tents of the hypervideo message data (i.e. message 
theme, the scenario data file, and the subject matter 
data files), and transmits these together with the notice 
board name information to each of the other server w 
computers that have been specified by the contents of 
the distribution condition memory 2182. 

It will be assumed that the sections shown in Fig. 74 
are configured, in the server computer of a LAN and in 
each of the server computers of that LAN, as shown in is 
the system block diagram of Fig. 75. Each client termi- 
nal C, formed of a I/O section 1 10, information browsing 
section 120 and hypervtdeo message generating sec- 
tion 165, is connected via the data communication path 
140 to the server computer S of the LAN. The server 20 
computer S includes the WWW data service section 
130 and hypervideo data service section 150, and also 
includes the hypervideo message input processing sec- 
tion 161, hypervideo message data distribution section 

1 62 and notice board page updating processing section 25 

163 which in combination constitute the hypervideo 
message posting processing section 160. These are 
interconnected in the same manner as described for the 
twelfth embodiment hereinabove. The server computer 

S further indudes the wide-area distribution processing 30 
section 2180, which transmits/receives distributed 
hypervideo message data to/from other server comput- 
ers via <a data communication path 1 194 of a wide-area 
network, which will be assumed in the following to be 
the Internet. 35 

Irrespective of whether the data of a hypervideo 
message are sent via the data communication path 140 
from a client terminal or via the data communication 
path 11 94 from another server computer, the message 
is posted by the same procedure, executed by the 40 
hypervideo message posting processing section 160. 
Specifically, the "message theme" part of the message 
is registered in the specified notice board (stored in the 
WWW data service section 130), while the scenario 
data and subject matter data of the message are stored 45 
in the hypervideo data service section 150, connected 
by hyperlink to the "message theme" registered in the 
notice board page, in the same manner as described for 
the twelfth embodiment hereineabove. 

The basic operations performed to distribute a mes- so 
sage to one or more specific server computers will be 
described referring to the simple system block diagram 
of Fig. 76. This shows three LANs designated as A, B 
and C respectively, with only one of the client terminals 
(C1, C2, C3) of each LAN being shown. It will be ss 
assumed that a hypervideo message is generated by 
the client terminal C1 and sent to the hypervideo mes- 
sage posting processing section 1 60 of the server com- 
puter A, with the message specifying the notice board 



name "New Products Guide" and the message theme 
being "29-inch Wide-Screen TV". As a result, when that 
message is posted by the hypervideo message posting 
processing section 160 of server computer A, the post- 
ing result detection section 2181 of that server compu- 
ter will detect the occurrence of the posting and will 
obtain the detection result data. The format of the detec- 
tion result data may for example be as shown in Fig. 77, 
and specifies the above-mentioned notice board name 
and message theme information. It will further be 
assumed that any message which is posted on the 
"New Products Guide" notice board of any of the server 
computers A, B and C is to be distributed to each of the 
other server computers. In that case, the distribution 
condition memory 2182 of each of the server computers 
A, B, C can for example contain respective distribution 
condition tables as shown in Figs. 78A, 78B, 78C 
respectively. Such a distribution condition table consists 
of a set of table entries each specifying a notice board 
name, in conjunction with a list of the names of the 
server computers which are to be distribution destina- 
tions for any message which is posted to that notice 
board. 

Various methods could be envisaged for the posting 
result detection section 2181 of a server computer to 
detect posting of a message by the hypervideo mes- 
sage posting processing section 160 of that server com- 
puter, so that specific description will be omitted. For 
example, the hypervideo message data distribution sec- 
tion 162 could be configured such as to directly notify 
the posting result detection section 2181 each time that 
a posting operation occurs. Alternatively, the posting 
result detection section 2181 could monitor each log-in 
operation executed from a dient terminal, whereby 
hypervideo message data are sent to the hypervideo 
message input processing section 161. 

Fig. 79 shows a distribution file group, which is a set 
of files for a hypervideo message that is to be distrib- 
uted, with this embodiment. That is to say, when distrib- 
uting a message, the distribution transmitting section 
2183 of the distribution server computer first transmits a 
header file, containing the aforementioned detection 
result data shown in Fig. 77, then scenario data file and 
subject matter data files which contain the actual con- 
tents of the message as described hereinabove for the 
twelfth embodiment. 

Fig. 80 is a flow diagram showing the basic opera- 
tion procedure of this embodiment, assuming the mes- 
sage distribution example of Fig. 76 and assuming that 
the contents of each distribution condition memory 
2182 of the server computers A, B, C are as shown iri 
Fig. 78A, 78B and 78C respectively. The steps of this 
procedure are as follows: 

Step 1 : Server computer A receives (from a local 
client terminal) a hypervideo message, and exe- 
cutes posting processing of the message to the 
specified notice board ("New Products Guide"): 
Step 2: The wide-area distribution processing sec- 
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tion 2180 of server computer A detects the server 
computers (B, C) which are specified as distribution 
destination servers for the ""New Products Guide"" 
notice board. 

Step 3: Server computer A distributes the newly s 
posted message to each of the distribution server 
«xxnputers (B, C), by transferring the distribution file 
group of the message to each of these server com- 
puters, using the FTP protocol. 

Step 4: Each of server computers B and C executes 10 
posting processing of the message to the "New 
Products Guide" notice board of that server compu- 
ter, i.e. to the notice board which is specified in the 
header file of the distribution file group. 

15 

The processing sequences which are executed by 
the distribution transmitting section 2183 of the server 
computer A, and by the distributed message receiving 
section 2184 of each of the server computers B and C, 
in step 2 of the flow diagram of Fig. 80, will be described 20 
in the following. Fig. 81 Is a flow diagram of the process- 
ing sequence which is executed by the distribution 
transmitting section 2183 of the server computer A, and 
which consists of the following operations: 

25 

Step 1 : Detection result are received from the post- 
ing result detection section 2181. indicating that a 
hypervideo message has been posted. 
Step 2: Look up the distribution condition table 
stored in the distribution condition memory 21 82, to 30 
find the names the of the server computers (B, C) to 
which the message is to be distributed, by finding 
the names of the server computers which corre- 
spond to the notice board name ""New Products 
Guide"". 35 
Step 3: Generate a header file for the distribution 
file group of this message, based on the contents of 
the detection result data. 

Step 4: Transmit the distribution file group to the 
distribution destination servers (B f C) ( using FTP 40 
data transfer. 

Fig. 82 is a flow diagram of the processing 
sequence which is executed by the distributed message 
receiving section 2184 of the server computer B, and 45 
which consists of the following operations: 

Step 1 : Receive and hold the distribution file group 
of the distributed hypervideo message. 
Step 2: Reconstitute the message in the standard 50 
hypervideo message format, using the "Notice- 
board Name" and "Message theme" data, from the 
header file of the distribution file group, and the data 
of the scenario data file and subject matter data 
files of the distribution file group as the contents of 55 
the message. 

Step 3: Request the hypervideo message posting 
processing section 160 to post that message, and 
supply the message data to the hypervideo mes- 



sage input processing section 1 61 . 

The contents of the above step 3 may simply con- 
sist of the action of supplying to the hypervideo mes- 
sage posting processing section 160 the notice board 
name and message theme information of the hyper- 
video message. However it can be understood that, 
since a hypervideo message is supplied to the hyper- 
video message input processing section 161 of the 
hypervideo message posting processing section 160 in 
the same way and with the same data format as a 
hypervideo message which is sent locally from a client 
terminal of the LAN, the hypervideo message posting 
processing section 160 of a server computer can exe- 
cute the same operations to post a message, irrespec- 
tive of whether a locally generated message or a 
distributed message is to be posted. 

Fig. 83 is a conceptual diagram for illustrating the 
synchronization relationships between respective 
processing operations which are executed by a server 
computer which posts and distributes a message and a 
server computer which receives and posts that mes- 
sage, e.g. between the server computers A and B in the 
above example: As shown, when the server computer A 
detects posting of a message, it uses the "put" com- 
mand of the Internet FTP (File Transfer Protocol) to 
transfer the distribution file group of the message to 
server computer B. On receiving the file group, server 
computer B posts the message to the ""New Products 
Guide"" notice board which is specified in the header file 
of that file group, with the scenario data ffle and subject 
matter data files from the distribution file group being 
stored in the hypervideo data service section 150 as the 
contents of the message. 

It can be understood from the above that with the 
twentieth embodiment described above, it is made pos- 
sible for a hypervideo message which is posted at the 
server computer of a LAN of a wide-area network to be 
selectively distributed to other server computers of the 
wide-area network, and hence made available to each 
of the client terminals of these other server computers. 
In particular, it can be ensured that all of the messages 
which are posted on a specif ic notice board of one LAN 
can be accessed (employing the usual data browsing 
operations, based on displayed hypertext pages) by any 
user of one or more other specified LANs. 

With the above embodiment, due to the fact that 
each server computer only executes message distribu- 
tion processing (using the FTP for data transfer) for 
hypervideo messages which are first posted at that 
server computer, the proportion of the total message 
distribution processing load which is imposed on a 
server computer will vary in proportion to the frequency 
with which messages are sent to that server computer 
from its client terminals. Hence, each server computer 
may be be configured in accordance with the antici- 
pated frequency of posting of messages at that site, so 
as to ensure that none of the server computers of the 
wide-area network will become excessively overloaded 
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by the CPU demand that is imposed by the hypervideo 
message distribution processing. 

Although the basic configuration of a server compu- 
ter and the client terminals of this embodiment have 
been assumed to be similar to those of the first embod- s 
iment described hereinabove, it would be equally possi- 
ble to configure these in accordance with the second or 
third embodiments. 

A twenty-first embodiment will be described in the 
following, which can have respective configurations for 10 
the server computer and client terminals that are similar 
to those described above for the twentieth embodiment. 
This embodiment differs from the preceding embodi- 
ment in that rather than the distribution server compu- 
ter transferring the entire data contents of a hypervideo is 
message in a distribution operation, only representative 
parts of the message data are initially transferred to 
each of the distribution destination server computers. 
Specifically, the notice board name, the message 
theme, and a list of the names and storage locations of 20 
the scenario and subject matter data files (e.g. directory 
path information for these files^ with respect to the 
hypervideo data service section 150 of the distribution 
server computer) are initially transmitted to each of the 
distribution destination server computers. In the follow- 25 
ing, such representative information will be referred to 
as the message updating information, with the format of 
that data being for example as shown in Fig. 84. When 
such a set of message updating information are 
received by a server computer as the destination of the so 
data, this signifies that a message having the theme 
"29-inch Wide-Screen TV" is to be posted on the ""New 
Produbts Guide"" notice board of that server computer, 
and that the data files of the message are stored in 
server computer A, at storage locations specified by the 35 
"list of stored files". 

The basic operation of this embodiment will be 
described, again using the simple distribution example 
of Fig. 76 in which a message is distributed from server 
computer A to the server computers B, C. It will again be 40 
assumed that the detection result data derived by 
server computer A is as shown in Fig. 77, i.e. specifying 
the name of the notice board on which the message has 
been posted, together with the message theme, and 
that the contents of the distribution condition memory 45 
2182 of each of the server computers A, B, C are as 
shown in Figs. 78 A. 78B and 78C respectively. 

Rg. 85 is a flow diagram showing the basic opera- 
tion sequence which is executed by the distribution 
transmitting section 2183 of the distribution server com- so 
puter A in this case, with the operation steps being as 
follows: 

Step 1 : Receive from posting result detection sec- 
tion 21 81 the detection result data for this message. 55 
Step 2: Refer to the distribution condition memory 
21 82 to find the names (B, C) of the server comput- 
ers which correspond to the notice board name 
""New Products Guide"". 



Step 3: Based on the detection result data, refer to 
the storage position information for hypervideo data 
which are stored in hypervideo data service section 
150, to obtain the storage position information for 
the scenario and subject matter data files contain- 
ing the message data contents, and combine that 
storage position information with the "Notice Board 
Name" and "Message Theme" information of the 
detection result data to thereby generate the mes- 
sage updating information. 

Step 4: Transmit the message updating information 
to the server computer B, using the SMTP (Simple 
Mail Transfer Protocol). 

Fig. 86 similarly shows the basic operation 
sequence executed by the distributed message receiv- 
ing section 2184 of each of the distribution destination 
server computers B, C. The steps are as follows: 

Step 1: Receive message updating information 
transmitted from server computer A. 
Step 2: Refer to the "List of Stored Files" in the 
message updating information, then execute the 
Internet FTP "get" command to acquire each of 
these files from the hypervideo data service section 
150 of the distribution server computer A 
Step 3: When all of the listed files (scenario data 
and subject matter data) have been acquired, i.e. all 
of the message data contents have been received, 
then configure the message data in the standard 
hypervideo message format. 
Step 4: Notify section 160 that a message is to be 
posted, and supply the message data to the hyper- 
video message input processing section 161. 

Rg. 87 is a conceptual diagram for illustrating the 
synchronization relationships between respective 
processing operations which are executed by a server 
computer which posts and distributes a message and a 
server computer which then receives and posts that 
message, e g. between the server computers A and B in 
the above example. As shown, when the distribution 
server computer A detects posting of a message, it then 
prepares and transmits the message updating informa- 
tion (using the SMTP) to the destination server compu- 
ter B. The server computer B then obtains from the 
message updating information the list of files containing 
the message contents, which are stored at server com- 
puter A and must be acquired. The server computer B 
then uses direct transfer of files (i.e. by executing the 
Internet FTP "get" command) to acquire each of the 
required files from the hypervideo data service section 
150 of server computer A, uses the acquired files and 
the contents of the message updating information to 
configure the message in the standard hypervideo mes- 
sage format, and then posts the message. 

With this embodiment, similar results can be 
achieved to those described for the twentieth embodi- 
ment described hereinabove. However with the twenty- 
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first embodiment only the message updating informa- 
tion (i.e. reference data, which can easily and rapidly be 
transferred between server computers of a wide-area 
network such as the Internet) is sent from the distribu- 
tion server computer to each destination server compu- 
ter, whereas the processing for acquiring the actual 
hypervideo data contents of a message (i.e. direct high- 
speed transfer of binary data files, using the FTP), 
which imposes a high load on the CPU of a server com- 
puter, is executed by each of the distribution destination 
server computers. Hence if a high frequency of mes- 
sage postings occurs in any one LAN of the wide-area 
network, so that the server computer of that LAN is cur- 
rently operating under high load, the processing for 
actually transferring the hypervideo data of these mes- 
sages to other server computers will be dispersed 
among these destination server computers. Hence, the 
overall operation of the wide-area network with respect 
to message distribution will not be adversely affected by 
a high frequency of message posting that may occur in 
one of the LANs. 

The decision as to whether to configure the wide- 
area distribution processing section 2180 of each server 
computer of a wide-area network in accordance with the 
twentieth or the twenty-first embodiment will depend 
upon the such factors as the anticipated type of utiliza- 
tion of client terminals of each site (i.e. the expected fre- 
quency of posting messages from the client terminals, 
or frequency of referencing of posted messages by cli- 
ent terminal users, etc.), and factors such as the type of 
message processing that is anticipated for the various 
server computers (e g. whether a server computer will 
primarily distribute messages to a large number of des- 
tinations, or will primarily receive messages that are dis- 
tributed, etc.). Generally speaking, if it is anticipated that 
message interchange between sites will be performed 
mainly on a two-way conversational basis, then the form 
of the twentieth embodiment is to be preferred, whereas 
in the case of a wide-area network in which a specific 
server computer will mainly be used to distribute mes- 
sages to other sites, then the form of the twenty-first 
embodiment is to be preferred. — 

A twenty-second embodiment of the invention will 
be described in the following, which has the basic con- 
figuration shown in Fig. 88. The configuration of this 
embodiment differs from that of the twenty-first and 
twenty-second embodiments described above only with 
respect to the addition of a schedule memory 2191 and 
a scheduling execution section 2192, so that description 
of the remaining portions will be omitted. The actual 
configuration of a server computer of this embodiment 
can be as shown in Fig. 75, but with the addition of the 
scheduling execution section 2192 and scheduling exe- 
cution section 2192, coupled as shown in Fig. 88 to the 
distributed message receiving section 2184 of the wide- 
area distribution processing section 21 80. The schedule 
memory 2191 has stored therein schedule information, 
consisting of a list of programs which are scheduled to 
be executed, in conjunction with respective scheduled 



execution times for these programs. The scheduling 
execution section 2192 serves to periodically execute 
these programs at the scheduled times, in accordance 
with the information held in the schedule memory 2191 . 

5 In describing the operation of this embodiment, the 

same example as for the two preceding embodiments 
will be employed, i.e. example of Fig. 76 in which a mes- 
sage is posted to a notice board of the server computer 
A of LAN A, and is distributed to server computers B 

10 and C of two other LANs. It will again be assumed that 
the detection result data derived by server computer A 
is as shown in Fig. 77, and that the contents of the dis- 
tribution condition memory 2182 of each of the server 
computers A, B, C are as shown in Figs. 78A, 78B and 

is 78C respectively. 

Fig. 89 shows an example of the configuration of an 
execution schedule table which is stored in the schedule 
memory 2191. The execution schedule table contains 
the following schedule data, in the form of respective 

20 records: 

Program that is scheduled to be executed: Name of 
a program (or name of the processing which is per- 
formed by that program) which is to be executed at pre- 
determined times. 

25 Scheduled time of execution: Information specifying 
the times at which the program is to be executed. 

In the example of Fig. 89 it is assumed that the pro- 
gram which is used to acquire message files (i.e. the 
scenario data file and subject matter data files of a dis- 

30 tributed message) is to be executed once each day, at 
21:00. 

The distribution processing sequence of this 
embodiment is almost identical to that of the twenty-first 
embodiment described above, but differs with respect to 

35 the operation of the distributed message receiving sec- 
tion 2184. Fig. 90 A is a one-step flow diagram showing 
the processing sequence executed by the distributed 
message receiving section 2184 in response to receiv- 
ing the message updating information of a distributed 

40 message, while Fig. 90B shows the operation sequence 
executed by the distributed message receiving section 
2184 in order to acquire the files which are listed in the 
message updating information of a distributed mes- 
sage. The operation of the distribution transmitting sec- 

45 tion 2183 of this embodiment is identical to that 
described above for the twenty-first embodiment, so 
that further description will be omitted. 

The operating sequence shown in Fig. 90A consists 
of the following: 

50 

Step 1 : When the message updating information of 
a distributed message is received, the message 
updating information are stored unchanged on the 
mail spool (i.e. a temporary storage region 
55 assigned for holding electronic mail items). 

The operating sequence shown in Fig. 90B consists 
of the following: 
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Step 1: Determine whether there is message 
updating information currently held on the mail 
spool (i.e. for one or more distributed hypervideo 
messages). If so. then successively process the 
message updating information for each of the dis- 5 
tributed messages, as follows. 
* Step 2: From the message updating information, 
obtain the "list of stored files", then successively 
transfer these files from the hypervideo data serv- 
ice section 150 of the distribution server computer 10 
by using the FTP "get" command in conjunction 
with the storage location information from the "list of 
stored files". Temporarily hold the successively 
transferred files. 

Step 3: Reconstruct message into standard hyper- 15 
video message format, using the data of the set of 
acquired files as the "message contents" part of the 
standard format, and using the "notice board name" 
and "message theme" information from the mes- 
sage updating information which had been held on 20 
the mail spool. 

Step 4: Notify section 160 that message is to be 
posted, and supply the hypervideo message input 
processing section 161. 

25 

Fig. 91 is a conceptual diagram for illustrating the 
synchronization relationships between respective 
processing operations which are executed by a server 
computer (A) which posts a hypervideo message and 
then distributes the message updating information for 3d 
that message to another server computer (B), for this 
embodiment As shown, when the distribution server 
computer A detects posting of a message, it then pre- 
pares and transmits the message updating information 
for that message (using the SMTP) to the destination 35 
server computer B. The server computer B temporarily 
stores the message updating information on the mail 
spool. Subsequently, at the next occurrence of the 
scheduled execution time of day (21:00), the server 
computer B executes processing to obtain the list of files 40 
which are specified in the message updating informa- 
tion, in the same way as described for the preceding 
embodiment, i.e. using the FTP. The message data are 
then configured to the standard format, and the mes- 
sage is posted by server computer B. 45 

The functions of the schedule memory 2191 and 
scheduling execution section 2192 can readily be imple- 
mented, for example by using the UNIX (a registered 
trade mark of UNIX System Laboratories Inc.) "cron 
facility, if the server computer uses the UNIX operating so 
system. Alternatively, the "System Agent" facility of the 
Windows 95 operating system can be utilized. "Win- 
dows" is a registered trade mark of Microsoft Corp., 
U.S.A. 

With this embodiment, in addition to the advantage ss 
of dispersal of CPU processing load that is provided by 
the twenty-first embodiment as described hereinabove, 
the advantage is obtained that it becomes possible to 
adjust the timings at which each each server computer 



(to which hypervideo messages are distributed) proc- 
esses the distributed messages. That is, each server 
computer can individually determine the time periods 
within which FTP data communication processing is 
executed to acquire the scenario data and subject mat- 
ter data files of distributed hypervideo messages. In that 
way, it becomes possible to set these execution time 
periods in accordance with the utilization conditions of a 
particular LAN, and in accordance with factors such as 
the requirements of other programs for FTP communi- 
cation, the CPU performance capabilities, etc. Alterna- 
tively, these file transfer time intervals can be 
determined based on the time of day at which the costs 
of using the communication path of the wide-area net- 
work are lowest. 

With this embodiment, message updating informa- 
tion for successively received distributed hypervideo 
messages are accumulated by a server computer, and 
posting processing is executed only at specified prede- 
termined times. For that reason, this embodiment is 
inferior to the preceding embodiment with respect to the 
speed with which a newly posted message at one site of 
the wide-area network is made available to users of 
other sites. However it would be possible to modify this 
embodiment, such as to ensure that when message 
updating information is received and stored on the mail 
spool of a server computer, the "message theme" part 
of the message is registered on the specified notice 
board page, held in the WWW data service section 130. 
In that way, the message theme" is made available to 
the users of client terminals of that site, to indicate that 
this message will be distributed. In that case it could for 
example be arranged that file transfer and posting of the 
message at that site are executed (prior to the next 
scheduled time for posting of messages) if so requested 
by any user. 

A twenty-third embodiment of the invention will be 
described in the following. The configuration and basic 
operation of this embodiment are similar to those of the 
twentieth embodiment described hereinabove, but dif- 
fers in that the data of a message which is to be distrib- 
uted are encoded using the aforementioned MIME 
encoding, and then distributed to other server comput- 
ers by using the SMTP, to be then decoded to obtain the 
original message contents. In practice, MIME encod- 
ing/decoding of data for SMTP transfer can be readily 
performed by using a suitable mailer program, i.e. a pro- 
gram which permits exchange of electronic mail 
between server computers of a wide-area network and 
which is applicable to MIME encoding. In that case, the 
encoding and decoding operations are executed auto- 
matically by the mailer program. 

With this embodiment as illustrated in Fig. 92, the 
aforementioned distribution file set for a message is first 
prepared. The data of that entire set of files are then 
MIME-encoded as a single large file, which is sent by 
SMTP to other server computers, is decoded, and then 
separated into the original set of data files, and the data 
are then configured in the standard hypervideo mes- 
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sage format. 

The reason for utilizing this embodiment is that in 
some cases, (as mentioned hereinabove with respect to 
the embodiments relating to hypervideo mail) it may not 
be possible to transfer data between server computers s 
by using the FTP protocol, i.e. whereby data of files 
whieh are stored at one server computer can be directly 
transferred (as a result of executing an Internet FTP 
"get" or "put" command) to another server computer, via 
the wide-area network However in such cases it will fre- 10 
quently be possible to reliably transfer data between the 
server computers by using the SMTP, if the data have 
been MIME-encoded. Such a case is illustrated in Fig. 
93, for the case of the aforementioned example of the 
server computers A. B, C of Fig. 76. In Fig. 93 (which is 
shows only the server computers of each LAN of the 
wide-area network, with client terminals being omitted) 
the server computers A, C are located in an environ- 
ment in which it is ensured that a continuous path will 
exist between these, via the wide-area network, during 20 
an FTP file transfer operation. However server compu- 
ter B is located in an environment in which such a path 
condition is not ensured between that server computer 
and server computer A, but for which reliable data trans- 
fer using the SMTP can be ensured. 25 

Various mail transfer programs are available for 
executing data transfer using the SMTP, such as the 
Unix "SendmaiT program (a registered trade name of 
Sun Microsystems Corp., US;A.). To use such a pro- 
gram it is necessary to set certain network path irrforma- 30 
tion into each server computer, beforehand. 

The basic operation sequence executed by this 
embodiment, for message distribution processing, will 
be described referring to the flow diagram of Fig. 94. 
This embodiment will be assumed to use the same for- 35 
mat and contents for the detection result data (i.e. 
shown in Fig. 77) and for the distribution condition 
tables (as shown in Figs. 78A, 78B, 78C) as described 
hereinabove. Fig. 94 shows the processing sequence 
executed by the distribution transmitting section 2183 of 40 
the wide-area distribution processing section 2180 of 
server computer A, for this embodiment i.e. again 
assuming the distribution example of Fig. 76. The 
sequence steps are as follows: 

45 

Step 1: Receive from the posting result detection 
section 2181 the detection result data from posting 
a hypervideo message. 

Step 2: Refer to distribution condition memory 2 1 82 
to find the names (B, C) of distribution destination so 
server computers which correspond to the notice 
board name ""New Products Guide"". 
Step 3: Generate message header file (containing 
notice board name ""New Products Guide"" and 
message theme "29-inch Wide-Screen TV"), based ss 
on detection resuH data. 

Step 4: Obtain message data contents (scenario 
data file, subject matter data files) from hypervideo 
service section 150, combine with message header 



file to obtain distribution file group, and MIME- 
encode data of file group to obtain a single encoded 
message. 

Step 5: Transmit MIME format message to each of 
the distribution destination server computers (B, C), 
using SMTP. 

Fig. 95 shows the processing sequence which is 
executed by the distributed message receiving section 
2184 of a server computer which receives a distributed 
hypervideo message, with this embodiment, e.g. the 
server computer B of the above example. The sequence 
steps are: 

Step 1: Receive the hypervideo message, sent by 

SMTP in MIME-encoded format 

Step 2: Decode to obtain the message data in the 

form of the distribution file group. 

Step 3: Reconstruct message data into standard 

hypervideo message format 

Step 4: Notify section 160 that message is to be 

posted, and supply the hypervideo message input 

processing section 161. 

Fig. 96 is a conceptual diagram for illustrating the 
synchronization relationships, for this embodiment, 
between respective processing operations which are 
executed by a server computer which posts and distrib- 
utes a message and a server computer which then 
receives and posts that message, e.g. between the 
server computers A and B in the example of Fig. 76. As 
shown, when the distribution server computer A detects 
posting of a message, it then encodes the message 
data and transmits the data by SMTP, and the destina- 
tion server computer B then decodes the received data 
and recovers the original hypervideo message, and 
posts the message. 

It can thus be understood that with this embodi- 
ment hypervideo messages can be distributed among 
server computers of a wide-area network, even if the 
data communication path conditions do not enable 
direct transfer of data files between the server comput- 
ers, i.e. even if a data communication path is not contin- 
uously maintained between the server computers. This 
is made possible by transferring afl of the data of a 
hypervideo message in MIME-encoded form, using the 
SMTP, in the same way as ordinary electronic mail is 
transferred via the Internet i.e. with the data being 
transferred during predetermined intervals when a com- 
munication path is available. 

By comparison with the preceding embodiments 
which utilize the FTP protocol for transferring the data 
contents of a hypervideo message during message dis- 
tribution, this embodiment has a slower speed of distri- 
bution. This is due to factors such as the time required 
to execute MIME encoding of the message contents, 
and also due to the low speed of data transfer of the Tel- 
net protocol, i.e. the lower-level data transfer protocol on 
which the SMTP is based. Furthermore as mentioned 



50 



99 



EP 0 756 420 A2 



100 



above, whereas with FTP data transfer the data are 
conveyed directly in binary form, the Telnet protocol 
transfers the data as ASCII code. Such a method there- 
fore presents problems with respect to transferring large 
amounts of data However this embodiment does ena- 5 
ble hypervideo message distribution to be accom- 
plished within a wide-area network, in those cases 
where FTP data transfer is not possible. 

A twenty-fourth embodiment of the invention will be 
described in the following, which is again basically sim- 10 
ilar in functions and structure to the twentieth embodi- 
ment. The basic configuration of this embodiment 
differs from that of the twentieth embodiment (shown in 
Fig. 74) only with respect to the wide-area distribution 
processing section 2180, and for that reason only the is 
internal configuration of the wide-area distribution 
processing section 21 80 of this embodiment is shown in 
Fig. 97, in relation to the hypervideo message posting 
processing section 160. A server computer of a wide- 
area network in accordance with this embodiment pref- 20 
erafcrfy has the structure shown in Fig. 75, but with the 
configuration of the wide-area distribution processing 
section 2180 being as shown in Fig. 97. As shown in 
Fig. 97, the wide-area distribution processing section 
2180 of this embodiment is formed of a posting result 25 
detection section 2181, a distribution condition memory 
2182, a 1st distribution transmitting section 2183a, a 
2nd distribution transmitting section 2 1 83b, a 1 st distrib- 
uted message data receiving section 2184a, a 2nd dis- 
tributed message data receiving section 2184b, and a 30 
2185. The function of the posting result detection sec- 
tion 2181 is identical to that of the two preceding 
embodiments, i.e. to detect each execution of message 
posting processing by the hypervideo message posting 
processing section 160. The function of the distribution 35 
condition memory 2182 is also identical to that of the 
two preceding embodiments, i.e. to hold information 
specifying those server computers to which any mes- 
sages that are posted to specif ic notice boards are to be 
distributed. The function of the 2183a is as follows. 40 
When message posting is executed by the hypervideo 
message posting processing section 160 so that the 
above-described detection result data are supplied to 
the 1st distribution transmitting section 2183a by the 
posting result detection section 2181, the distribution 45 
transmitting section 2183 obtains from the distribution 
condition memory 2182 the names of each server com- 
puter to which the newly posted message is to be dis- 
tributed, then generates the aforementioned message 
updating information (e.g. as shown in Fig. 84) contain- so 
ing the notice board name and message theme informa- 
tion-together with information ("list of stored files") 
indicating the storage^ locations (within the hypervideo 
data service section 1 50) of the actual data contents of 
the message, and transmits the message updating ss 
information (by SMTP transfer) to each of the distribu- 
tion destination server computers. 

With this embodiment, as described hereinafter, it 
is possible that it may be necessary to retransmit the 



contents of a message that is to be distributed, in MIME- 
encoded form. This MIME encoding and retransmission 
function is performed by the 2nd distribution transmit- 
ting section 2183b, i.e. by preparing a distribution file 
group containing all of the message data and then 
MIME-encoding that group as a single file, which is 
transferred by SMTP as described hereinabove. 

The functions of the 1st message receiving section 
2184a are as follows. In response to receving message 
updating information for a distributed hypervideo mes- 
sage, The 1st distributed message data receiving sec- 
tion 2184a executes processing to acquire the data of 
the distribution file group, from the distribution server 
computer, by FTP file transfer. If these files are success- 
fully acquired, then the 1st distributed message data 
receiving section 2184a arranges the hypervideo mes- 
sage in the standard message format, using the notice 
board name and message theme information from the 
header file of the distribution file group, and using the 
data of the "list of stored files" as the message data con- 
tents. The 1st distributed message data receiving sec- 
tion 2184a then notifies the hypervideo message 
posting processing section 160 that this message is to 
be posted, and supplies the message to the hypervideo 
message posting processing section 160. However if 
the files of the distribution file group are not successfully 
acquired by using FTP transfer, then the 1st distributed 
message data receiving section 2184a generates a 
request which is transmitted (by SMTP) to the distribu- 
tion server computer, to request that the message be 
encoded as a MIME file and retransmitted using the 
SMTP 

The 2nd distributed message data receiving section 
2184b executes decoding of a message which is 
received in MIME-encoded form by SMTP transfer, and 
reconfigures the message in the standard hypervideo 
message format, then notifies the hypervideo message 
posting processing section 160 that this message is to 
be posted, and supplies the message data to the hyper- 
video message posting processing section 160; 

The distribution message data input processing 
section 2185 receives data sent from other server com- 
puters of the wide-area network, and specif ically judges 
whether message updating information of a distributed 
hypervideo message, a MIME-encoded distributed 
hypervideo message, or a request for retransmission of 
a hypervideo message has been received. If message 
updating information are received, then the distribution 
message data input processing section 2185 supplies 
the data to the 1st distributed message data receiving 
section 2184a. If a MIME-encoded hypervideo message 
is received then the data are supplied to the 2nd distrib- 
uted message data receiving section 2184b. If a request 
for message retransmission is received, then the distri- 
bution message data input processing section 2185 
notifies the 2nd distribution transmitting section 2183b 
that the message is to be encoded in MIME form and 
retransmitted by SMTP to the server computer which 
has sent the retransmission request 



51 



n75fvd?nA9 i ^ 



101 



EP0 756 420 A2 



102 



Within a wide-area network, it is possible that there 
may be domains (i.e. regions of the wide-area network) 
defined with a lirewall protection" feature, such that 
direct transfer of stored f8es of one server computer 
from another server computer (e.g. by using the FTP 
protocol) is permitted within the domain, but with such 
direct file transfer being inhibited for server computers 
which are located outside the domain. That point has 
been mentioned hereinabove with respect to the 
embodiments relating to hypervideo mail, and is illus- 
„ trated in Figs. 98A, 98B. It will again be assumed that 
the server computers A, B and C correspond to those of 
the hypervideo message distribution example of Fig. 76 
described hereinabove. In Fig. 98 A the server compu- 
ter B is assumed to be located in a domain in which FTP 
data transfer via the network between server computer 
B and server computer F is possible, but with such data 
transfer between server computer A (located outside 
the domain of server computer B) not being possible, 
although transfer of MIME-encoded data using the 
SMTP protocol, from server computer A to server com- 
puter B is possible. That relationship is illustrated in the 
table of Fig. 98B. 

Fig. 99 shows the format of retransmission request 
data which are sent by the 2nd distribution transmitting 
section 2183b of a distribution server computer and are 
received by each of the destination server computers. 
The constituent parts of the such request data are as 
follows: "Request name": This part of the data specifies 
the nature of the request that is being made to a desti- 
nation server computer. 

"Server computer name": This identifies the server 
computer which is sending the request data. 

"Notice board name": The name of the notice board 
of the message for which retransmission is being 
requested, i.e. the notice board of the hypervideo mes- 
sage whose files could not be transferred using FTP 
communication. 

"Message theme": The "message theme" part of 
the message for which retransmission is being 
requested. 

The basic operation sequence executed by this 
embodiment, for message distribution processing, will 
be described referring to the flow diagram of Fig. 100. 
This embodiment will be assumed again use the distri- 
bution example of Fig. 76, and the same format and 
contents for the detection result data (i.e. shown in Fig. 
77) and for the distribution condition tables (as shown in 
Figs. 78A 78B, 78C) as described hereinabove, i.e. so 
that when a message is posted at server computer A 
the message is to be distributed to each of the server 
computers B and C. Fig. 94 shows the processing 
sequence executed by the 1st distribution transmitting 
section 2183a of the wide-area distribution processing 
section 21 80 of server computer A for this embodiment. 
The sequence steps of Fig. 1 00 are as follows: 

Step 1 : The detection result data, is provided from 
the posting result detection section 2181 when the 



hypervideo message is posted, are received. 
Step 2: The distribution condition memory 2182 is 
referred to, to find the names (B, C) of the distribu- 
tion server computers corresponding to the notice 

5 board name ""New Products Guide"" which is spec- 

ified in the detection result data. 
Step 3: Based on the detection result data, the stor- 
age position information for hypervideo data stored 
in hypervideo data service section 150 is searched, 

10 to obtain the storage position information for the 
message scenario and subject matter data files, to 
be inserted in the message updating information, 
and the complete set of message updating informa- 
tion is prepared. 

is Step 4: The message updating information is trans- 
mitted to each of the server computers B, C, by 
using the SMTP. 

The operation sequence of the 2183b is as shown 
20 in the flow diagram of Ftg. 101, with the sequence steps 
being as follows (again for the case of the server com- 
puter A): 

Step 1 : Retransmission request data are received, 
25 e.g. from the server computer B. 

Step 2: Based on the retransmission request data, 
the name of distribution destination server compu- 
ter which is requesting retransmission is deter- 
mined. 

30 Step 3: The message header file is configured, 
using the "message name" and "message theme" 
information of the posted message. 
Step 4: The message contents are obtained from 
the hypervideo data service section 150, as the 

35 contents of the scenario data file and the subject 
matter data ffles, and converted to a MIME- 
encoded message. 

Step 5: The MIME format message is transmitted to 
the server computer B, using the SMTP. 

40 

Fig. 102 is a flow diagram which shows the opera- 
tion sequence executed by the 1 st distributed message 
data receiving section 2184a of this embodiment. The 
sequence steps are as follows, assuming that the 1st 
45 distributed message data receiving section 2184a is 
that of the server computer B in the example of Fig. 76: 

Step 1: Message updating information are 
received. 

50 Step 2: The "list of stored files" in the message 
updating information is examined, to obtain the file 
names and storage information (directory path) for 
the listed files, and the "get" command is executed, 
to attempt to acquire the data of these files from the 

55 distribution server computer A 

Step 3: If the files are not successfully acquired, 
then operation proceeds to step 4, otherwise oper- 
ation proceeds to step 5. 

Step 4: Retransmission request data are generated 
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, based on the contents of the message updating 
information, and sent to distribution server compu- 
ter. 

Step 5: The hypervideo message is reconstructed 
in standard format, using the data of the acquired 
files (scenario and subject matter data) as the 
• "message contents" part, together with the "notice 
board name" and "message theme" information 
which were provided in the message updating infor- 
mation. 

Step 6: Section 160 is requested to post the hyper- 
video message, and the message data are supplied 
to section 160. 

Fig. 103 is a flow diagram which shows the opera- 
tion sequence executed by the 2nd distributed message 
data receiving section 2184b of this embodiment. The 
sequence steps are as follows, assuming that the 2nd 
distributed message data receiving section 2184b is 
that of the server computer B in the example of Fig. 76: 

Step 1: A MIME-encoded hypervideo message is 
received. 

Step 2: The message is decoded to obtain the cor- 
responding multi-file format message. 
Step 3: The message data are arranged in the 
standard hypervideo message format 
Step 4: Section 160 is requested to post the hyper- 
video message, and the message data are supplied 
to section 160. 

Fig. 104 is a flow diagram which shows the opera- 
tion sequence executed by the cfistribution message 
data input processing section 2185 of this embodiment. 
The sequence steps are as follows, assuming that the 
distribution message data input processing section 
2185 is that of the server computer B in the example of 
Fig. 76; - 

Step 1 : Data are received from another server com- 
puter of the wide-area network. 
Step 2: Depending upon the type of data received, 
processing proceeds to step 3, 4 or 5. 
Step 3: If the received data are message updating 
information, then that fact is notified to the 1st dis- 
tributed message data receiving section 2184a, 
and the data are supplied thereto. 
Step 4: If the received data are MIME-encoded (i.e. 
in electronic mail format) then that fact is notified to 
, the 2nd distributed message data receiving section 
2184b, and the data are supplied thereto. 
Step 5: If the received data are "request for retrans- 
mission" data; then that fact is notified to the 2nd 
distribution transmitting section 2183b, and the data 
are supplied thereto. 

Fig. 105 is a conceptual diagram for illustrating the 
synchronization relationships, for this embodiment, 
between respective processing operations which are 



executed by a server computer which posts and distrib- 
utes a message and a server computer which then 
receives and posts that message, e.g. between the 
server computers A and B in the example of Fig. 76. As 

5 shown, when the distribution server computer (A) 
detects posting of a hypervideo messageg, it then gen- 
erates message updating information for that message 
and transmits the message updating information, using 
the SMTR to each of the specified destination server 

w computers (e.g. server computer B). When a destina- 
tion server computer receives the message updating 
information, it obtains the storage position information 
for the files containing the data contents of the message 
(from the message updating information, as described 

is above) and uses FTP transfer to obtain the file contents, 
and can thereby post the message. 

However if server computer B fails to acquire the file 
data by FTP transfer, then server computer B sends to 
server computer A, by SMTP, the message retransmis- 

20 sion request data. After analyzing the message retrans- 
mission request data, server computer A encodes the 
message data in MIME format and sends the data by 
SMTP to server computer B. The server computer B 
then recovers the original hypervideo message data 

25 from the MIME-encoded data, and executes processing 
to post the message. 

It can thus be understood that this embodiment is 
applicable to a wide-area network within which high- 
speed transfer of file data of a hypervideo message 

30 between server computers, using the FTP, may be pro- 
hibited in some cases, whereas data transfer using a 
system which has been designed for electronic mail 
transmission (i.e. the SMTP) between server computers 
is always possible. With this embodiment, data transfer 

35 is executed as far as possible by using the most rapid 
method, i.e. FTP. However when an unsuccessful 
attempt at such data transfer, from a distribution server 
computer to one of the group of destination server com- 
puters (i.e. which correspond to the notice board name 

40 of the message) occurs, then that destination server 
computer requests the distribution server computer to 
retransmit the data of the hypervideo message in the 
form of a single MIME-encoded "electronic mail" item. 
It will be apparent that various modifications of this 

45 embodiment could be envisaged. For example, 
although the embodiment has been described for the 
case of using only two different data transfer protocols 
(FTP direct transfer of binary data and SMTP transfer of 
MIME-encoded data), it may be possible to use three or 

so more different types of data transfer protocol. Which- 
ever is the case, the same principles as those described 
above would apply, i.e. it would first be attempted to 
transfer data using the fastest possible protocol, then, if 
unsuccessful, the next-fastest, and so on. 

55 From the above description of embodiments of the 
invention, it will be understood that the invention pro- 
vides great flexibility and convenience of use, together 
with ease of data managenent, in providing multimedia 
data to users of a data communication network in which 
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users can search for and obtain desired data by a proc- 
ess of browsing through displayed hypertext pages 
while utilizing an input device such as a mouse, i.e. a 
network such as the Internet or an "intranet" which is 
configured within a specific organization. 

It will further be understood that although the inven- 
tion has been described in the above based upon spe- 
cific embodiments, the invention is not limited to these 
embodiments, and various modifications to the embodi- 
ments could be envisaged, which fall within the scope 
claimed for the invention in the appended claims. 

Claims 

1 , An information provider apparatus comprising 

data input/output means including data input 
means (1 1 1) operable by a user for inputting 
operating commands, and data display means 
(112) for displaying a plurality of types of mon- 
omedia data including at least video data and 
text data, said operating commands being gen- 
erated by hyperlink selection in accordance 
with a page of hypertext data which is currently 
being displayed by said data display means 
(112); 

data storage means for storing hypertext data 
and data of at least one hypervideo clip, said 
hypervideo data clip data being formed of sub- 
ject matter data and scenario data, said subject 
matter data comprising data of a plurality of 
monomedia data items which include a video 
dip that has been preassigned as a reference 
video clip of said hypervideo clip, said scenario 
data including information specifying times of 
starting playing of respective ones of said mon- 
omedia data items other than said reference 
video clip, said starting times being specified in 
terms of frame numbers of said reference video 
clip; 

means responsive to said operating com- 
mands for reading out, from said data storage 
means, said scenario data and subject matter 
data of a hypervideo clip which is specified by 
said operating commands; and 
means for 

continuously supplying said reference video 
clip data of the specified hypervideo clip to said 
data data display means (112) to be displayed 
thereby, as said reference video clip data are 
read out from said data storage means, and for 
maintaining a count of elapsed frame numbers 
of said reference video clip, 
selectively generating data transfer commands 
to acquire from said data storage means spe- 
cific subject matter data of said specified 
hypervideo clip other than said reference video 
clip, at times determined in accordance with 
said said count of frame numbers in conjunc- 



tion with said scenario data, and 
continuously supplying said specific subject 
matter data to said data data display means 
(1 12) as said specific subject matter data are 

s read out from said data storage means, with 

video data of said subject matter data being 
transferred to said data display means (1 12) at 
a transmission rate which permits real-time 
transfer and continuous-motion display of the 

10 contents of said video data. 

2. An information provider apparatus comprising 

first data service means (130) including first 
15 data storage means (131) having stored 

therein hypertext page data and monomedia 
data, said monomedia data including scenario 
reference data corresponding to respective 
hypervideo clips, said scenario reference data 
20 being connected by hyperlinks to said hyper- 

text page data, said scenario reference data 
including storage location information for 
respective scenario data files of said hyper- 
video clips within second data storage means 
25 (151), said first data service means being 

responsive to externally supplied first data 
transfer commands for selectively reading out 
said hypertext page data and scenario refer- 
ence data; 

30 second data service means (150). including 

said second data storage means (151) having 
stored therein data constituting said hyper- 
video dips, responsive to second data transfer 
commands for selectively reading out said 

35 data, the data of a hypervideo clip consisting of 

a scenario data file and a plurality of subject 
matter data files for respective monomedia 
data Hems, said monomedia data items includ- 
ing a video clip which has been preassigned as 

40 a reference video clip, said scenario data 

including storage location information for said 
subject matter data files with respect to said 
second data storage means (151) and playing 
information including times of starting playing 

45 the contents of respective ones of said subject 

matter data files other than said reference 
video dip, said starting times being specified in 
terms of frame numbers of said reference video 
dip; 

so data input/output means (110) induding input 

means (111) operable by a user for inputting 
operating commands and data data display 
means (112) for playing a plurality of types of 
monomedia data including at least video data 

55 and text data, said operating commands being 

generated by hyperlink selection from a page 
of hypertext data which is currently being dis- 
played by said data display means (112); 
information browsing means (120) comprising 
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information browsing control means (121). 3. 
acquired data storage means (122) and hyper- 
video data playing means (124), 
said information browsing control means (121) 
being responsive to said operating commands s 
for generating corresponding ones of said first 
data transfer commands to thereby acquire, 
from said first data service means (130), data 
of a specific one of said hypertext pages or 
scenario reference data for a specific one of w 
said hypervideo clips, 

said acquired data storage means (1 22) storing 
said acquired hypertext page data and sce- 
nario reference data, with said hypertext page 
data being read out and supplied to said data 75 
display means (112), and 
said hypervideo data playing means (124) 
reading out said scenario reference data from 
said acquired data storage means (122) and 
using said scenario reference data to generate 20 
said second data transfer commands for 
thereby obtaining the scenario data data of 
said specific hypervideo clip from said second 4. 
data service means (150), using said scenario 
data to further generate said second data 25 
transfer commands for thereby obtaining said 
reference video clip data of said specific hyper- 
video clip from said second data service 
means and continuously supplying said refer- 
ence video clip data to said data display means 30 
(112), maintaining a count of elapsed frame 
numbers of said reference video clip, further 
1 generating said second data transfer com- 
mands to begin obtaining from said second 
data service means the contents of specific 35 
subject matter data files of said hypervideo clip 
at respective times determined in accordance 
with said said count of frame numbers in con- 
junction with said scenario data, and continu- 
ously supplying said contents to said data 40 
display means (112); and 
first data transfer means for transferring said 
first data transfer commands from said informa- 
tion browsing control means (121) to said first 
data service means (130) and for transferring 45 
resultant hypertext page data and scenario ref- 
erence data to be stored in said acquired data 
storage means (122), and second data transfer 
means for transferring said second data trans- 
fer commands from said hypervideo data play- so 
. ing means (124) to said second data service 
means and for transferring resultant scenario 
data and subject matter data to said hyper- 
video data playing means (124), said second 
data transfer means executing said data trans- ss 
fer at a transmission rate permitting real-time 
transfer with continuous-motion display of the 
contents of video data portions of said subject 
matter data. 



An information provider apparatus according to 
claim 2, comprising a data communication path 
(140) connecting said information browsing means 
(120) to said first data service means (130), said 
data communication path having a transmission 
bandwidth sufficiently wide to permit real-time data 
transfer of video data with continuous-motion dis- 
play of the data contents, wherein said first data 
transfer means comprise a first data communica- 
tion system (141) for transferring, via said data 
communication path (140), said first data transfer 
commands (140) to said first data service means 
(130) and resultant hypertext data and scenario ref- 
erence data to be stored in said acquired data stor- 
age means (122), and a second data 
communication system (142) for transferring, via 
said data communication path (140), said second 
data transfer commands to said second data serv- 
ice means and resultant scenario data and subject 
matter data to said hypervideo data playing means 
(124). 

An information provider apparatus comprising 

first data service means (130) including first 
data storage means (131) having stored 
therein hypertext page data and monomedia 
data files, said monomedia data files including 
files containing scenario data for respective 
hypervideo clips, said scenario data files being 
connected by hyperlinks to said hypertext page 
data, said first data service means being 
responsive to externally supplied first data 
transfer, commands for selectively reading out 
said hypertext page data and scenario data 
files; 

second data service means (150), including 
second data storage means (151) having 
stored therein subject matter data of said 
hypervideo clips, with the subject matter data 
of a hypervideo clip consisting of a plurality of 
monomedia data items configured respective 
subject matter data files, said monomedia data 
items including a video clip which has been 
preassigned as a reference video clip, said 
scenario data of a hypervideo clip including 
information specifying times of starting playing 
of respective ones of said monomedia data 
items other than said reference video clip, said 
starting times being specified in terms of frame 
numbers of said reference video clip; 
data input/output means including input means 
(111) operable by a user for inputting operating 
commands and data data display means (1 12) 
for playing a plurality of types of monomedia 
data, including at least video data and text 
data, said operating commands being gener- 
ated by hyperlink selection in accordance with 
a page of hypertext data which is currently 
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being displayed by said data display means 
(112); 

information browsing means (120) comprising 
information browsing control means (121), 
acquired data storage means (122) and hyper- s 
video data playing means (124), 
* said information browsing control means (121) 
being responsive to said operating commands 
for generating corresponding ones of said first 
data transfer commands to thereby acquire, io 
from said first data service means (130), data 
of a specific one of said hypertext pages or 
scenario data for a specific one of said hyper- 
video clips, 

said acquired data storage means (1 22) storing 15 
said acquired hypertext data or scenario data, 
said hypertext data being read out and sup- 
plied to said data display means (112); 
said hypervideo data playing means (124) 
comprising means for reading out said see- 20 
nario data from said acquired data storage 
means (122), using said scenario data to gen- 
erate said second data transfer commands for 
thereby obtaining said reference video dtp data 
of said specific hypervideo clip from said sec- 25 
ond data service means (150) and continu- 
ously supplying said reference video clip data 
to said data display means (1 12), maintaining a 
count of elapsed frame numbers of said refer- 
ence video clip, further generating said second 30 
data transfer commands to begin obtaining 
from said second data service means the con- 
tents of specific subject matter data files of said 
specific hypervideo clip at times determined in 
accordance with said count of frame numbers 35 
in conjunction with said scenario data, and 
continuously supplying said specific subject 
matter data file contents to said data display 
means (112); and 

first data transfer means for transferring said 40 
first data transfer commands from said informa- 
tion browsing control means (121) to said first 
data service means (130) and for transferring 
resultant hypertext data and scenario data to 
be stored in said acquired data storage means 45 
(122), and second data transfer means for 
transferring said second data transfer com- 
mands from said hypervideo data playing 
means (124) to said second data service 
means and for transferring resultant hyper- so 
video subject matter data to said hypervideo 
data playing means (124), said second data 
transfer means executing said data transfer at 
a transmission rate permitting real-time trans- 
fer with continuous-motion display of the con- ss 
tents of video data portions of said subject 
matter data. 

5. An information provider apparatus according to 



daim 4, comprising a data communication path 
(140) connecting said information browsing means 
(120) to said first data service means (130), 
wherein said first data transfer means comprise a 
first data communication system (141) for transfer- 
ring, via said data communication path (140), said 
first data transfer commands (140) to said first data 
service means (130) and resultant hypertext page 
data and scenario data to be stored in said 
acquired data storage means (122), and a second 
data communication system (142) for transferring, 
via said data communication path (140), said sec- 
ond data transfer commands to said second data 
service means and resultant subject matter data to 
said hypervideo data playing means (124). 

6. An information provider apparatus comprising 

data service means (130) induding first data 
storage means (131) having stored therein 
hypertext page data and monomedia data, said 
monomedia data including title data sets for 
each of respective hypervideo clips, each said 
title data set being connected by a hyperlink to 
said hypertext page data, each said title data 
set consisting of a file of scenario data and a 
plurality of subject matter data files for respec- 
tive monomedia data items, said monomedia 
data items including a video dip which has 
been preassigned as a reference video dip, 
said scenario data induding information speci- 
fying times of starting playing of contents 
respective ones of said subject matter data 
files other than that of said reference video dip, 
said starting times being specified in terms of 
frame numbers of said reference video dip, 
said data service means being responsive to 
externally supplied data transfer commands for 
selectively reading out respective ones of said 
title data sets and hypertext data pages; 
data input/output means including input means 

(1 1 1) operable by a user for inputting operating 
commands and data data display means (112) 
for playing a plurality of types of monomedia 
data, induding at least video data and text 
data, said operating commands being gener- 
ated by hyperlink selection in accordance with 
a page of hypertext data which is currently 
being cfisplayed by said data display means 

(112) ; 

information browsing means (120) comprising 
information browsing control means (121), 
acquired data storage means (122) and hyper- 
video data playing means (124), 
said information browsing control means (121) 
being responsive to said operating commands 
for generating corresponding data transfer 
commands, to acquire an updated hypertext 
data page or a specific title data set from said 
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data service means (130), 
said acquired data storage means (122) storing 
said acquired hypertext data page or title data 
set, said hypertext data being read out and 
supplied to said data display means (1 12), and s 
said hypervideo data playing means (124) 
reading out said scenario data and data of said 
reference video clip of the specific title data set 
from said acquired data storage means (122) 
and continuously supplying said reference 10 
video clip data to said data display means 
(112), maintaining a count of elapsed frame 
numbers of said reference video clip, further 
reading out, from said acquired data storage 
means (122), specific subject matter data files is 
of sad specific title data set at times deter- 
mined in accordance with said count of frame 
numbers in conjunction with said scenario 
data, and for continuously supplying said sub- 
ject matter data file contents to said data dis- 20 
play means (112), with video data portions of 
said specific subject matter data being being 
supplied to said data display means (112) at a 
transmission rate permitting real-time transfer 
with continuous-motion display; and 25 
data transfer means for transferring said data 
transfer commands from said information 
browsing control means (121) to said data 
service means (130) and for transferring result- 
ant contents of a title data set to be stored in so 
said acquired data storage means (122). 

7. An information provider apparatus according to 
claim 6, comprising a data communication path 
(140) connecting said information browsing means 35 
(120) to said first data service means (130), 
wherein said data transfer means comprises a data 
communication system (141) for transferring, via 
said data communication path (140), said data 
transfer commands to said first data service means 40 
(130) and resultant hypertext page data or title data 

set contents to be stored in said acquired data stor- 
age means (122). 

8. An information provider apparatus according to 45 
claim 3 or 5, wherein said data input/output means 
110 and information browsing means (120) in com- 
bination constitute a client terminal, and wherein 
said first data service means and second data serv- 
ice means in combination constitute a server com- so 
puter for providing hypertext data and hypervideo 
data to said client terminal, said client terminal and 
server computer being mutually connected by said 
data communication path (140). 

55 

An information provider apparatus according to 
claim 8. comprising a plurality of said client termi- 
nals, each connected to said server computer by 
said data communication path (140) for mutually 



independently communicating with said server 
computer, said data communication path being 
configured as a network data communication path. 

10. An information provider apparatus according to 
claim 3 or 5, wherein said data input/output means 
110 and and information browsing means (120) in 
combination constitute a client terminal, wherein 
said first data service means constitutes a first 
server computer and second data service means 
constitutes a second server computer, said first and 
second server computers in combination providing 
hypertext data and hypervideo data to said client 
terminal, said client terminal and first and second 
server computers being mutually connected by said 
data communication path (140). 

11. An information provider apparatus according to 
claim 10, comprising a plurality of said client termi- 
nals, each connected to said first and second 
server computers by said data communication path 
(140) for mutually independently communicating 
with said server computers, said data communica- 
tion path being configured as a network data com- 
munication path. 

12. An information provider apparatus according to 
claim 3 or 5, wherein said data input/output means 
110 and information browsing means (120) in com- 
bination constitute a client terminal, wherein said 
second data service means comprises a discontin- 
uous media data service means (1 50a) for storing 
and managing parts of said subject matter data 
which consist of discontinuous media data, and a 
continuous media data service means (150b) for 
storing and managing parts of said subject matter 
data which consist of continuous media data , 
wherein said non-continuous media data sen/ice 
means (150a) in combination with said first data 
service means (130) constitutes a first server com- 
puter and said non-continuous media data service 
means (150a) constitutes a second server compu- 
ter, said first and second server computers in com- 
bination providing hypertext data and hypervideo 
data to said client terminal, said client terminal and 
first and second server computers being mutually 
connected by said data communication path (140). 

13. An information provider apparatus according to 
claim 12, comprising a plurality of said client termi- 
nals, each connected to said first and second 
server computers by said data communication path 
(140) for mutually independently communicating 
with said server computers, said data communica- 
tion path being configured as a network data com- 
munication path. 

14. An information provider apparatus according to 
claim 3 or 5, wherein said data input/output means 
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110 and information browsing means (120) in com- 
bination constitute a client terminal, said first data 
service means (130) constitutes a first server com- 
puter, and said second data service means com- 
prises at least s 

* scenario data service means, constituting a 
second server computer, for storing and man- 
aging scenario data of hypervideo clips, 
video data service means, constituting a third w 
server computer, for storing and managing 
video data of hypervideo clips, 
audio data service means, constituting a fourth 
server computer, for storing and managing 
audio data of hypervideo clips, is 
stilt picture data service means, constituting a 
fifth server computer, for storing and managing 
still picture data of hypervideo clips, and 
text data service means, constituting a sixth 
server computer, for storing and managing text 20 
data of hypervideo dips; 
said first, second third, fourth, fifth, and sixth 
server computers in combination providing 
hypertext data and hypervideo data to said cli- 
ent terminal, said client terminal and first, sec- 25 
ond third, fourth, fifth, and sixth server 
computers being mutually connected by said 
data communication path (140). 

15. An information provider apparatus according to 30 
claim 14, comprising a plurality of said client termi- 
nals, each connected to said first, second third, 
fourth, fifth, and sixth server computers by said data 
communication path (140) for mutually independ- 
ently communicating with said server computers, 35 
said data communication path being configured as 

a network data communication path. 

16. An information provider apparatus according to 
claim 3 or 5, wherein said data input/output means 40 
110. information browsing control means 120 and 
first data service means (130) in combination con- 
stitute a client terminal, and wherein said second 
data service means constitutes a server computer 

for providing hypervideo data to said client terminal, 45 
said client terminal and server computer being 
mutually connected by said data communication 
path (140). 

17. An information provider apparatus according to so 
claim 16, comprising a plurality of said client termi- 
nals, each connected to said server computer by 
said data communication path (140) for mutually 
independently communicating with said server 
computer, said data communication path being ss 
configured as a network data communication path, 
wherein said first data service means of each said 
client terminal holds stored, in said first data stor- 
age means thereof , scenario reference data or sce- 



nario data which are utilized solely by said client 
terminal. 

18. An information provider apparatus according to 
claim 3 or 5, wherein said second data service 
means consists of a primary means (150k) and a 
secondary means (150h), wherein said data 
input/output means 110, information browsing con- 
trol means 120 and secondary means (150h) of the 
second data service means in combination consti- 
tute a client terminal, and wherein said first data 
service means and said primary means (150k) of 
the second data service means in combination con- 
strtutes a server computer for providing hypertext 
data and hypervideo data to said client terminal, 
said client terminal and server computer being 
mutually connected by said data communication 
path (140). 

19. An information provider apparatus according to 
claim 1 8, comprising a plurality of said client termi- 
nals, each connected to said server computer by 
said data communication path (140) for mutually 
independently communicating with said server 
computer, said data communication path being 
configured as a network data communication path, 
wherein said secondary means (150h, 150i, 150j) 
of said second data service means of each said cli- 
ent terminal holds stored, in said second data stor- 
age means thereof, subject matter data which are 
utilized solely by said client terminal, and in which 
said primary means of the second data service 
means holds stored, in said second data storage 
means thereof, subject matter data which are for 
use in common by said plurality of client terminals. 

20. An information provider apparatus according to 
claim 3 or 5, wherein said second data service 
means consists of primary means (150n) and sec- 
ondary means (150m), wherein said data input/out- 
put means 110, information browsing control 
means 120 and secondary means (150m) of the 
second data service means in combination consti- 
tute a client terminal, and wherein said first data 
service means (130e) and said primary means 
(150) of the second data service means in combi- 
nation constitutes a server computer for providing 
hypertext data and hypervideo data to said client 
terminal, said second data storage means of said 
primary means (150n) of the second data service 
means holding master data, said second data stor- 
age means of said secondary means (1 50m) of the 
second data service means holding data obtained 
by copying at least a specific portion of said master 
data, said client terminal and server computer 
being mutually connected by said data communica- 
tion path (140), further comprising switch means 
disposed within said data communication path, 
operable for selectively connecting said client termi- 
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nal to said server computer to enable said master 
data to be transferred and copied by said client ter- 
minal. 

21. An information provider apparatus according to 5 
claim 20, comprising a plurality of said client termi- 
nals, each connected to said server computer by 
said data communication path (140) through the 
intermediary of respective ones of said switch 
means for mutually independently communicating 10 
with said server computer, said data communica- 
tion path being configured as a network data com- 
munication path. 

22. An information provider apparatus according to is 
claim 3 or 5, wherein said second data service 
means consists of a primary means (150q) and a 
secondary means (150p), wherein said data 
input/output means 110, information browsing con- 

: trol means 120, first data service means (130) and 20 
\ secondary means (150p) of the second data serv- 

ice means in combination constitute a client termi- 
nal, and wherein said said primary means (150q) of 
the second data service means constitutes a server 
computer for providing hypertext data and hyper- 25 
video data to said client terminal, said second data 
storage means of said primary means (150q) of the 
second data service means holding complete sub- 
ject matter data of hypervideo data to be used by 
said client terminal, said second data storage 30 
means of said secondary means (150p) of the sec- 
ond data service means holding abstract portions 
of said complete subject matter data, said data 
communication path (140) being connected 
between said client terminal and said server com- 35 
puter, for connecting said primary means (150q) of 
the second data service means to said information 
browsing means (120), and said secondary means 
(150p) of the second data service means being 
connected to said information browsing means 40 
(120) by an interna] circuit path within said client 
terminal. — 

23. An information provider apparatus according to 
claim 22, comprising a plurality of said client termi- 45 
nals, each connected to said server computer by 
said data communication path (140) for mutually 
independently communicating with said server 
computer, said data communication path (140) 
being configured as a network data communication so 
path. 

24. An information provider apparatus according to 
claim 3 further comprising hypervideo mail 
processing means (1 70) for processing hypervideo ss 
mail items each consisting of a hypervideo dip in 
combination with at least mail destination informa- 
tion, said hypertext data in said data storagemeans 
(131) further including hypervideo mail page data 



containing, for each of respective hypervideo mail 
items received by said hypervideo mail processing 
means, said mail destination information in con- 
junction with a hyperlink to the scenario reference 
data file of said mail item, said hypervideo mail 
processing means comprising: 

temporary mail storage means, 
mail processing means (170) for receiving 
externally supplied hypervideo mail Hems, 
extracting said destination information from an 
externally supplied hypervideo mail item, trans- 
ferring the subject matter data and scenario 
data contents of said hypervideo mail item to 
said second data service means (150) to be 
stored in said second data storage means, and 
transferring resultant storage location informa- 
tion for said subject matter data and scenario 
data in conjunction with said mail destination 
information, to said first data service means 
(130) for thereby generating a scenario refer- 
ence file for said mail item and updating said 
hypervideo mail page data. 

25. An information provider apparatus according to 
claim 24, wherein said hypervideo mail generating 
means (1 80), said data input/output means 110 and 
said information browsing means (120) in combina- 
tion constitute a client terminal, and wherein said 
hypervideo mail processing means (170). first data 
service means (130) and second data service 
means (150) in combination constitute a mail server 
computer, said client terminal and mail server com- 
puter being mutually connected by said data com- 
munication path (140). 

26. An information provider apparatus according to 
claim 25. comprising a plurality of said client termi- 
nals, each connected to said mail server computer 
by said data communication path (1 40) for mutually 
independently communicating with said mail server 
computer, said data communication path being 
configured as a network data communication path. 

27. An information provider apparatus according to 
claim 26, wherein at least one of said client termi- 
nals comprises hypervideo mail generating means, 
operable for generating arbitrary hypervideo mail 
items. 

28. An information provider apparatus according to 
claim 27. comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-network 
data communication path (194) connecting said 
plurality of local area networks, wherein said mail 
server computer of a local area network executes 
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dedicated storage of data of hypervideo mail items 
having as destinations any of said client terminals 
of said local area network, wherein each of said 
mail server computers further comprises destina- 
tion enquiry management means (179) for provkJ- 5 
ing information specifying respective hypervideo 
mail item storage dedication relationships between 
said mail server computers and client terminals, 
and wherein an originating client terminal functions, 
prior to sending a hypervideo mail item to a destina- w 
tion client terminal, to obtain from said destination 
management means of the mail server computer of 
said originating client terminal, the identity of the 
dedicated mail server computer of said destination 
client terminal, and to then transmit said hypervideo 15 
mail item to said dedicated mail server computer. 



computer mutually connected by a network data 
communication path (140), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, with said inter-server data communica- 
tion path extending through a wide-area data com- 
munication network, wherein in each of said mail 
server computers said hypervideo mail processing 
means (195) is coupled to receive hypervideo mail 
items sent from other local area networks via said 
inter-server data communication path (1194) in 
addition to hypervideo mail items sent via said net- 
work data communication path (140) from client ter- 
minals of the local area network of said mail server 
computer, and wherein said hypervideo mail 
processing means further comprises 



29. An information provider apparatus according to 
claim 27, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-network 
data communication path (194') for mutually con- 
necting said local area networks, said inter-network 
data communication path (1 94*) having a transmis- 
sion bandwidth sufficiently wide to enable real-time 
transfer of video data with continuous-motion dis- 
play, wherein said mail server computer of a local 
area network executes dedicated receiving and 
storage of all hypervideo mail Herns transmitted by 
the client terminals of said local area network, and 
wherein said mail processing means (190) of each 
of said mail server computers further comprises 

table memory means for providing information 
specifying respective dedicated receiving and 
storage relationships between said client termi- 
nals and said mail server computers and 
means for 

judging that a received hypervideo mail item 
has as its destination a client terminal which is 
not within the local area network of said each 
mail server computer, 

transferring said hypervideo mail item to said 
second data service means (150) to be stored 
in said second data storage means (151), 
generating a reference mail item including stor- 
age location information for said hypervideo 
mail item, and 

transmitting said reference mail item to the mail 
server computer of the local area network con- 
taining said client terminal which is the destina- 
tion of said hypervideo mail item. 

30. An information provider apparatus according to 
claim 27, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 



mail destination information memory means 
(196) providing information which specifies, for 
20 each of said client terminals, the mail server 

computer of the corresponding local area net- 
work, and 

means (197, 198) for judging whether a hyper- 
video mail item received from a client terminal 

25 of said local area network of the mail server 

computer has as its destination a client termi- 
nal located within another one of said local 
area networks, and, if so, obtaining from said 
mail destination information memory means 

30 (196) the name of the mail server computer of 

the local area network of said destination client 
terminal, and transmitting said hypervideo mail 
item via said inter-server data communication 
path (1 1 94) to said mail server computer. 

35 

31. An information provider apparatus according to 
claim 27, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 

40 computer mutually connected by a network data 
communication path (1 40), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, wherein in each of said mail server com- 

45 puters said hypervideo mail processing means 
(1 195) is coupled to receive hypervideo mail items 
sent from other local area networks via said inter- 
server data communication path (1 194) in addition 
to locally originated hypervideo mail items which 

so are sent via said network data communication path 
(1 40) from client terminals of the local area network 
of said mail server computer, with said inter-server 
data communication path extending through a 
wide-area data communication network, and 

55 wherein said hypervideo mail processing means 
further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
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each of said client terminals, the maii server 
computer of the corresponding local area net- 
work, and 

means (1199, 1195a. 198) functioning, when a 
received locally originated hypervideo mail 5 
item is judged to have as its destination a client 
terminal within some other local area network, 
to supply said hypervideo mail item to said sec- 
ond data service means (150) to be stored in 
said second data storage means (151), to gen- w 
erate a reference mail item containing the des- 
tination information and storage location 
information for said hypervideo mail item, and 
to transmit said reference mail item via said 
inter-server data communication path (1 1 94) to is 
the mail server computer of said destination cli- 
ent terminal, 

functioning, when a reference mail item is 
received via said inter-server data communica- 
tion path (1194), to update said mail page data 20 
held in said first data storage means (131) in 
accordance with the contents of said reference 
mail item, 

functioning, when said reference mail item is 
selected by a user from a client terminal, by 2s 
hyperlink selection from said mail page data, to 
generate and transmit to the originating mail 
server computer of said reference mail item, 
via said inter-server data communication path 
(1 194), a request for transmission of the hyper- 30 
video mail item corresponding to said refer- 
ence mail item, and 
> functioning, when said corresponding hyper- 
video mail item is received via said inter-server 
data communication path (1194), to supply 35 
said hypervideo mail item to said second data 
service means (150) to be stored in said sec- 
ond data storage means (151), and to update 
said mail page information held in said first 
data storage means (131) in accordance with 40 
destination information and storage location 
information for said hypervideo mail item. 

32. An information provider apparatus according to 
claim 27 1 comprising a plurality of local area net- 45 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-server data 
communication path (1194) mutually connecting so 
respective mail server computers of said local area 
networks, wherein in each of said mail server com- 
puters said hypervideo mail processing means 
(195) is coupled to receive hypervideo mail items 
sent from other local area networks via said inter- 55 
server data communication path (1 194) in addition 
to hypervideo mail items sent via said network data 
communication path (140) from client terminals of 
the local area network of said mail server computer, 



and wherein said hypervideo mail processing 
means further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, 

means (197. 198) for judging whether a hyper- 
video mail item received from a client terminal 
of said local area network of the mail server 
computer has as its destination a client termi- 
nal located within another one of said local 
area networks, and, if so, obtaining from said 
mail destination information memory means 
(196) the name of the mail server computer of 
the local area network of said destination client 
terminal, and 

means for encoding said hypervideo mail item 
in the form of an electronic mail item and for 
transmitting a resultant encoded hypervideo 
mail item via said inter-server data communica- 
tion path (1194) to said mail server computer 
by using a data communication protocol which 
is designed for exchange of electronic mail 
items in a wide-area network; 
and wherein each of said mail server comput- 
ers further comprises decoding means for 
decoding each said encoded hypervideo mail 
item, when received from said inter-server data 
communication path. 

33. An information provider apparatus according to 
daim 32, wherein each said data communication 
protocol is the Simple Mail Transfer Protocol 
(SMTP), and said encoding is executed using the 
Multipurpose Internet Mail Extensions code 

- (MIME). 

34. An information provider apparatus according to 
claim 27, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (1 40), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, with said inter-server data communica- 
tion path extending through the Internet, wherein in 
each of said mail server computers said hypervideo 
mail processing means (195) is coupled to receive 
hypervideo mail items sent from other local area 
networks via said inter-server data communication 
path (1194) in addition to hypervideo mail items 
sent via said network data communication path 
(1 40) from client terminals of the focal area network 
of said mail server computer, and wherein said 
hypervideo mail processing means further com- 
prises 
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mart destination information memory means 
(196) providing information which specifies to- 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, 

means (1 97, 1 98 ) for judging whether a hyper- 
- video mail item received from a client terminal 
of said local area network of the mail server 
computer has as its destination a client termi- 
nal located within another one of said local 
area networks, and. if so. obtaining from said 
, m ^wf tinati0n information memory means 
(196) the name of the mail server computer of 
the local area network of said destination client 
terminal, 

means for generating a reference mail item 
specifying at least the name of the destination 
client terminal of said hypervideo mail item 
and for transmitting said reference mail item via 

rf-.l.w er " S6rVer data co-^unication path 
(1 1 94) to said mail server computer of the local 

area network of said destination client terminal 
means responsive to receiving a reference mail 
S inter-server data communication 

path (1194) for generating a request for trans- 
rn.ss.on in encoded form of the hypervideo mail 
item corresponding to said reference mail item, 
and for transmitting said request via said inter- 
server data communication path (1194) to an 
ong.nat.ng mail server computer of said 
received reference mail item, and 
means responsive to receiving a request for 
transmission of a hypervideo mail item in 
encoded form for encoding said hypervideo 
mail item .n the form of an electronic mail item 
and for transmitting a resultant encoded hyper- 
vKieo mail item via said inter-server data com- 
munication path (1194) to said mail server 
computer, using a data communication proto- 
col wh.ch is designed for exchange of elec- 
tronic mail in a wide-area network, 
each of said mail server computers further 
composing decoding means for decoding each 
said encoded hypervideo mail item when 
received from said inter-server data communi- 
cation path. 

35. An information provider apparatus according to 
cairn 5. further comprising hypervideo mail 
processing means (170) for processing hypervideo 
maj. items each consisting of a hypeL^^ 
coronation with at least mail destination informa- 

SS yp TL data in said data Stora 9 e «*« 

(131) further including hypervideo mail page data 
contemmg. for each of respective hypervideo mail 
•terns received by said hypervideo mail processing 
means, said mail destination information in con 
junction with a hyperlink to the scenario data file of 
said ma.l item, said hypervideo mail processing 
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temporary mail storage means, 
mail processing means (170) for receiving 
externally supplied hypervideo mail items 
extracting said destination information from an 
externally supplied hypervideo mail item, trans- 
ferring the subject matter data contents of said 
hypervideo mail item to said second data serv- 
ice means (150) to be stored in said second 
data storage means (151), and transferring the 
scenario data contents of said hypervideo mail 
•tern to said first data service means (1 30) to be 
stored in said first data storage means (131) 
said hypervideo mail page data being 
updated accordingly 

36 ' T^^T PmMer apparatus aiding to 
claim 35, wherein hypervideo mail generat.no 

™*r«(180). sa.ddatainputvoufoutmearino^d 
said information browsing means (120) in combina- 
jonconstrtute a client terminal, and wherein said 
nypemdeo mail processing means (170). first data 
service means (130) and second data servfce 
^s(150)^cc^inationconstituteamail server 
computer, said cl.errt terminal and mail server com- 
puter being mutually connected by said data com- 
munication path (140). 

30 ^ £ i r£ mati0n Pr0Vider a PP aratus «*o««ng to 
claim 36 comprising a plurality of said client termi- 
ni * a w, TOnneCted to "** ma " se™* computer 
by sari data communication path (140) for mutually 
independently communicating with said mail server 
computer, said data communication path beina 
configured as a network data communication path 

^ ir TS mat, ° n provkter apparatus according to 
claim 37. comprising a plurality of focal area net- 

TStZU, ^ networks comprising 

a pluralrty of sad client terminals and a mail server 
computer mutually connected by a network data 
communication path (140). and an inter-network 
da a communication path (194) connecting said 
pluralrty of local area networks, wherein said ma« 

Sd^t!ST ter ° f 3 10031 »"* netw °* «ecutes 
^ a9e ° f <* nypervideo mail items 
having as dest.nat.ons any of said client terminals 
of sad local area network, wherein each of said 
mail server computers further comprises destina- 
tion enquiry management means (179) for provid- 
ing information specifying respective hypervideo 
mail item storage dedication relationships between 
sari mail server computers and client terminals, 
and wherein an originating client terminal functions 
pnor to sending a hypervideo mail item to a destina- 
tion client terminal, to obtain from said destination 
management means of the mail server computer of 
said originating client terminal, the identity of the 
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dedicated mail server computer of said destination 
client terminal, and to then transmit said hypervideo 
mail item to said dedicated mail server computer. 

39. An information provider apparatus according to 5 
claim 37, comprising a plurality of local area net- 

* works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-network w 
data communication path (194') for mutually con- 
necting said local area networks, said inter-network 
data communication path (194') having a transmis- 
sion bandwidth sufficiently wide to enable real-time 
transfer of video data with continuous-motion dis- is 
play, wherein said mail server computer of a local 
area network executes dedicated receiving and 
storage of all hypervideo mail items transmitted by 
the client terminals of said local area network, and 
- wherein said mail processing means (190) of each 20 
of said mail server computers further comprises 

table memory means for providing information 
specifying respective dedicated receiving and 
storage relationships between said client termi- 25 
nals and said mail server computers and 
means for 

judging that a received hypervideo mail item 
has as its destination a client terminal which is 
not within the local area network of said each 30 
mail server computer, 

transferring said hypervideo mail item to said 
* second data service means (1 50) to be stored 
in said second data storage means (151), 
generating a reference mail item including stor- 35 
age location information for said hypervideo 
mail item, and 

transmitting said reference mail item to the mail- 
server computer of the local area network con- 
taining said client terminal which is thedestina- 40 
tion of said hypervideo mail item. 

40. An information provider apparatus according to 
claim 37, comprising a plurality of local area net- 
works, each of said local area networks comprising 45 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area so 
networks, with said inter-server data communica- 
tion path extending through a wide-area data com- 
munication network, wherein in each of said mail 
server computers said hypervideo mail processing 
means (195) is coupled to receive hypervideo mail 55 
items sent from other local area networks via said 
inter-server data communication path (1194) in 
addition to hypervideo mail items sent via said net- 
work data communication path (140) from client ter- 



minals of the local area network of said mail server 
computer, and wherein said hypervideo mail 
processing means further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, and 

means (197, 198) for judging whether a hyper- 
video mail item received from a dient terminal 
of said local area network of the mail server 
computer has as its destination a dient termi- 
nal located within another one of said local 
area networks, and, if so, obtaining from said 
mail destination information memory means 
(1 96) the mail server computer of the local area 
network of said destination client terminal, and 
transmitting said hypervideo mail item via said 
inter-server data communication path (11 94) to 
said mail server computer. 

41. An information provider apparatus according to 
daim 37, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said dient terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, wherein in each of said mail server com- 
puters said hypervideo mail processing means 
(1 1 95) is coupled to receive hypervideo mail items 
sent from other local area networks via said inter- 
server data communication path (1194) in addition 
to locally originated hypervideo mail items which 
are sent via said network data communication path 
(140) from dient terminals of the locat area network 
of said mail server computer, with said inter-server 
data communication path extending through a 
wide-area data communication network, and 
wherein said hypervideo mail processing means 
further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, and 

means (1199, 1195a, 198) functioning, when a 
received locally originated hypervideo mail 
item is judged to have as its destination a dient 
terminal within some other local area network, 
to supply said hypervideo mail item to said sec- 
ond data service means (150) to be stored in 
said second data storage means (151), to gen- 
erate a reference mail item containing the des- 
tination information and storage location 
information for said hypervideo mail item, and 
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to transmit said reference mail item via said 
inter-server data communication path (1 194) to 
the mail server computer of said destination cli- 
ent terminal, 

functioning, when a reference mail item is s 
received via said inter-server data communica- 
- tion path (1 194), to update said mail page data 
held in said first data storage means (131) in 
accordance with the contents of said reference 
mail item, w 
functioning, when said reference mail item is 
selected by a user from a client terminal, by 
hyperlink selection from said mail page data, to 
generate and transmit to the originating mail 
server computer of said reference mail item, 15 
via said inter-server data communication path 
(1 1 94), a request for transmission of the hyper- 
video mail item corresponding to said refer- 
ence mail item, and 

functioning, when said corresponding hyper- 20 
video mail item is received via said inter-server 
data communication path (1194). to supply 
said hypervideo mail item to said second data 
service means (150) to be stored in said sec- 
ond data storage means (151), and to update 25 
said mail page information held in said first 
data storage means (131) in accordance with 
destination information and storage location 
information for said hypervideo mail item. 

30 

42. An information provider apparatus according to 
claim 37, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 35 
communication path (140). and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, wherein in each of said mail server com- 
puters said hypervideo mail processing means 40 
(195) is coupled to receive hypervideo mail items 
sent from other local area networks-via said inter- 
server data communication path (1 194) in addition 
to hypervideo mail items sent via said network data 
communication path (140) from client terminals of 45 
the local area network of said mail server computer, 
and wherein said hypervideo mail processing 
means further comprises 

mail destination information memory means so 
(196) providing information which specifies, for 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, 

means (197, 198) for judging whether a hyper- 
video mail item received from a client terminal 
of said local area network of the mail server 
computer has as its destination a client termi- 
nal located within another one of said local 



area networks, and, if so, obtaining from said 
mail destination information memory means 
(196) the name of the mail server computer of 
the local area network of said destination client 
terminal, and 

means for encoding said hypervideo mail item 
in the form of an electronic mail item and for 
transmitting a resultant encoded hypervideo 
mail item via said inter-server data communica- 
tion path (1 1 94) to said mail server computer; 
and wherein each of said mail server comput- 
ers further comprises decoding means for 
decoding each said encoded hypervideo mail 
item, when received from said inter-server data 
communication path. 

43. An information provider apparatus according to 
claim 37. comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (1 40), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, wherein in each of said mail server com- 
puters said hypervideo mail processing means 
(195) is coupled to receive hypervideo mail items 
sent from other local area networks via said inter- 
server data communication path (1 1 94) in addition 
to hypervideo mail items sent via said network data 
communication path (140) from client terminals of 
the local area network of said mail server computer, 
and wherein said hypervideo mail processing 
means further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, 

means (197, 198) for judging whether a hyper- 
video mail item received from a client terminal 
of said local area network of the mail server 
computer has as its destination a client termi- 
nal located within another one of said local 
area networks, and, if so, obtaining from said 
mail destination information memory means 
(196) the name of the mail server computer of 
the local area network of said destination client 
terminal, 

means for generating a reference mail item 
specifying at least the name of the destination 
client terminal of said hypervideo mail item, 
and for transmitting said reference mail item via 
said inter-server data communication path 
(1 1 94) to said mail server computer of the local 
area network of said destination client terminal, 
means responsive to receiving a reference mail 
item from said inter-server data communication 
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path (1 1 94) for generating a request for trans- 
mission in encoded form of the hypervideo mail 
item corresponding to said reference mail item, 
and for transmitting said request via said inter- 
server data communication path (1194) to an 5 
originating mail server computer of said 
received reference maii item, and 
means responsive to receiving a request for 
transmission of a hypervideo mail item in 
encoded form for encoding said hypervideo 10 
mail item in the form of an electronic mail item 
and for transmitting a resultant encoded hyper- 
video mail item via said inter-server data com- 
munication path (1194) to said mail server 
computer by using a data communication pro- is 
tocol which is designed for exchange of elec- 
tronic mail in a wide-area network; 
each of said mail server computers further 
comprising decoding means for decoding each 
said encoded hypervideo mail item, when 20 
received from said inter-server data communi- 
cation path. 

44. An information provider apparatus according to 
claim 7, further comprising hypervideo mail 25 
processing means (1 70) for processing hypervideo 
mail items each consisting of a hypervideo clip in 
combination with at least mail destination informa- 
tion, said hypertext data in said data storage means 
(131) further including hypervideo mail page data 30 
containing, for each of respective hypervideo mail 
items received by said hypervideo mail processing 
means, said mail destination information in con- 
junction with a hyperlink to the scenario reference 
data file of said mail item, said hypervideo mail 35 
processing means comprising: 

temporary mail storage means; 
mail processing means (170) for receiving 
externally supplied hypervideo mail items, 40 
extracting said destination information from an 
externally supplied hypervideo mail item, trans- 
ferring the subject matter data and scenario 
data contents of said hypervideo mail item to 
said data service means (130) to be stored in 45 
said data storage means as a title data: set 
which is connected by a hyperlink to said mail 
page data, and updating said mail page data in 
accordance with said extracted destination 
information, 50 

45; An information provider apparatus according to 
claim 44, wherein said hypervideo mail generating 
means (180), data input/output means 110 and 
information browsing means (120) in combination 55 
constitute a client terminal, and wherein said hyper- 
video mail processing means (1 70) and data serv- 
ice means (130) in combination constitute a mail 
server computer, said client terminal and, mail 



server computer being mutually connected by said 
data communication path (140). 

46. An information provider apparatus according to 
claim 45, comprising a plurality of said client termi- 
nals, each connected to said mail server computer 
by said data communication path (140) for mutually 
independently communicating with said mail server 
computer, said data communication path being 
configured as a network data communication path. 

47. An information provider apparatus according to 
claim 46, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-network 
data communication path (194) connecting said 
plurality of local area networks, wherein said mail 
server computer of a local area network executes 
dedicated storage of data of hypervideo mail items 
having as destinations any of said client terminals 
of said local area network, wherein each of said 
mail server computers further comprises destina- 
tion enquiry management means (179) for provid- 
ing information specifying respective hypervideo 
mail item storage dedication relationships between 
said mail server computers and client terminals, 
and wherein an originating client terminal functions, 
prior to sending a hypervideo mail item to a destina- 
tion client terminal, to obtain from said destination 
management means of the mail server computer of 
said originating client terminal, the identity of the 
dedicated mail server computer of said destination 
client terminal, and to then transmit said hypervideo 
mail item to said dedicated mail server computer 

48- An information provider apparatus according to 
claim 47, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-network 
data communication path (194*) for mutually con- 
necting said local area networks, said inter-network 
data communication path (194*) having a transmis- 
sion bandwidth sufficiently wide to enable real-time 
transfer of video data with continuous-motion dis- 
play, wherein said mail server computer of a local 
area network executes dedicated receiving and 
storage of all hypervideo mail items transmitted by 
the client terminals of said local area network, and 
wherein said mail processing means (190) of each 
of said mail server computers further comprises 

table memory means for providing information 
specifying respective dedicated receiving and 
storage relationships between said client termi- 
nals and said mail server computers and 
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means for 

judging that a received hypervideo mail item 
has as its destination a client terminal which is 
not within the local area network of said each 
mail server computer, s 
transferring said hypervkJeo mail item to said 
* data service means (130) to he stored in said 
first data storage means (131). 
generating a reference mail item including stor- 
age location information for said hypervideo 10 
mail item, and 

transmitting said reference mail item to the mail 
server computer of the local area network con- 
taining said client terminal which is the destina- 
tion of said hypervideo mail item. is 

49. An information provider apparatus according to 
claim 46, comprising a plurality of local area net- 
works, each of said local area networks comprising 

a plurality of said client terminals and a mail server 20 
computer mutually connected by a network data 
communication path (140), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, with said inter-server data communica- 25 
tion path extending through a wide-area data com- 
munication network, wherein in each of said mail 
server computers said hypervideo mail processing 
means (195) is coupled to receive hypervideo mail 
items sent from other local area networks via said 30 
inter-server data communication path (1194) in 
addition to hypervideo mail Hems sent via said net- 
work data communication path (140) from client ter- 
minals of the local area network of said mail server 
computer, and wherein said hypervideo mail 35 
processing means further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
each of said client terminals, the mail server 40 
computer of the corresponding local area net- 
work, and — 
means (197, 198) for judging whether a hyper- 
video mail item received from a client terminal 
of said local area network of the mail server 45 
computer has as its destination a client termi- 
nal located within another one of said local 
area networks, and, if so, obtaining from said 
mail destination information memory means 
(1 96) the mail server computer of the local area so 
network of said destination client terminal, and 
transmitting said hypervideo mail item via said 
inter-server data communication path (1 194) to 
said mail server computer of the destination cli- 
ent terminal. 55 

50. An information provider apparatus according to 
claim 46, comprising a plurality of local area net- 
works, each of said local area networks comprising 



a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, wherein in each of said mail server com- 
puters said hypervideo mail processing means 
(1195) is coupled to receive hypervideo mail items 
sent from other local area networks via said inter- 
server data communication path (1 194) in addition 
to locally originated hypervideo mail items which 
are sent via said network data communication path 
(140) from client terminals of the local area network 
of said mail server computer, with said inter-server 
data communication path extending through a 
wide-area data communication network, and 
wherein said hypervideo mail processing means 
further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, and 

means (1 199, 1 195a, 198) functioning, when a 
received locally originated hypervideo mail 
item is judged to have as its destination a client 
terminal within some other local area network, 
to supply said hypervideo mail item to said data 
service means (130) to be stored in said first 
data storage means (131), to generate a refer- 
ence mail item containing the destination infor- 
mation and storage location information for 
said hypervideo mail item, and to transmit said 
reference mail item via said inter-server data 
communication path (1194) to the mail server 
computer of said destination client terminal, 
functioning, when a reference mail item is 
received via said inter-server data communica- 
tion path (1 194), to update said mail page data 
held in said first data storage means (131) in 
accordance with the contents of said reference 
mail item, 

functioning, when said reference mail item is 
selected by a user from a client terminal, by 
hyperlink selection from said mail page data, to 
generate and transmit to the originating mail 
server computer of said reference mail item, 
via said irrter-server data communication path 
(1 1 94), a request for transmission of the hyper- 
video mail item corresponding to said refer- 
ence mail item, and 

functioning, when said corresponding hyper- 
video mail item is received via said irrter-server 
data communication path (1194), to supply 
said hypervideo mail item to said data service 
means (130) to be stored in said first data stor- 
age means (131), connected by a hyperlink to 
said mail page data, and to update said mail 
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page information in accordance with the desti- 
nation information for said hypervideo mail 
item. 

51. An information provider apparatus according to s 
claim 30, 31. 36, 41, 49 or 50 wherein said wide- 
area data communication network is the Internet. 

52. An information provider apparatus according to 
claim 46, comprising a plurality of local area net- 10 
works, each of said local area networks comprising 

a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (140), and an inter-server data 
communication path (1194) mutually connecting is 
respective mail server computers of said local area 
networks, with said inter-server data communica- 
tion path extending through the Internet, wherein in 
each of said mail server computers said hypervideo 
mail processing means (195) is coupled to receive 20 
hypervideo mail items sent from other local area 
networks via said inter-server data communication 
path (1194) in addition to hypervideo mail items 
sent via said network data communication path 
(140) from client terminals of the local area network 25 
of said mail server computer, and wherein said 
hypervideo mail processing means further com- 
prises 

mail destination information memory means 30 
(196) providing information which specifies, for 
each of said client terminals, the mail server 
computer of the corresponding local area net- 
work, 

means (197, 198) for judging whether a hyper- 35 
video mail item received from a client terminal 
of said local area network of the mail server 
computer has as its destination a client termi- 
nal located within another one of said local 
area networks, and, if so, obtaining from said 40 
mail destination information memory means 
(196) the name of the maif-server computer of 
the local area network of said destination client 
terminal, and 

means for encoding said hypervideo mail item 45 
in the form of an electronic mail item and for 
transmitting a resultant encoded hypervideo 
mail item via said inter-server data communica- 
tion path (1194) to said mail server computer 
by using a using a data communication proto- so 
col which is designed for exchange of elec- 
tronic mail in a wide-area network, 
and wherein each of said mail server comput- 
ers further comprises decoding means for 
decoding each said encoded hypervideo mail 55 
item, when received from said inter-server data 
communication path. 

53. An information provider apparatus according to 



claim 46, comprising a plurality of local area net- 
works, each of said local area networks comprising 
a plurality of said client terminals and a mail server 
computer mutually connected by a network data 
communication path (1 40), and an inter-server data 
communication path (1194) mutually connecting 
respective mail server computers of said local area 
networks, wherein in each of said mail server com- 
puters said hypervideo mail processing means 
(195) is coupled to receive hypervideo mail items 
sent from other local area networks via said inter- 
server data communication path (1 194) in addition 
to hypervideo mail items sent via said network data 
communication path (140) from client terminals of 
the local area network of said mail server computer, 
and wherein said hypervideo mail processing 
means further comprises 

mail destination information memory means 
(196) providing information which specifies, for 
each of sard client terminals, the mail server 
computer of the corresponding local area net- 
work, 

means (197, 198) for judging whether a hyper- 
video mail item received from a client terminal 
of said local area network of the mail server 
computer has as its destination a client termi- 
nal located within another one of said local 
area networks, and, if so, obtaining from said 
mail destination information memory means 
(196) the name of the mail server computer of 
the local area network of said destination client 
terminal, 

means for generating a reference mail item 
specifying at least the name of the destination 
client terminal of said hypervideo mail item, 
and for transmitting said reference mail item via 
said inter-server data communication path 
(1 1 94) to said mail server computer of the local 
area network of said destination client terminal, 
means responsive to receiving a reference mail 
item from said inter-server data communication 
path (1194) for generating a request for trans- 
mission in encoded form of the hypervideo mail 
item corresponding to said reference mail item, 
and for transmitting said request via said inter- 
server data communication path (1 194) to an 
originating mail server computer of said 
received reference mail item, and 
means responsive to receiving^ a request for 
transmission of a hypervideo mail item in 
encoded form for encoding said hypervideo 
mail item in the form of an electronic mail item 
code and for transmitting a resultant encoded 
hypervideo mail item via said inter-server data 
communication path (1 1 94) to said mail server 
computer; 

each of said mail server computers further 
comprising decoding means for decoding each 
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said encoded hypervideo mail item, when 
received from said inter-server data communi- 
cation path. 

54. An information provider apparatus according to 
claim 34, 42. 43, 52 or 

S3, wherein each said encoded hypervideo mail 
item is transmitted via the Internet by utilizing the 
Simple Mail Transfer Protocol (SMTP), and said 
encoding is executed using the Multipurpose Inter- 
net Mail Extensions code (MIME). 

55. An information provider apparatus according to 
claim 2, 4 or 6, wherein said hypertext page data 
held in said first data storage means (131) include 
data of at least one page which is assigned as a 
notice board, said information provider apparatus 
further comprising hypervideo message posting 
processing means (160) for receiving externally 
supplied hypvervideo messages each formed of 
scenario data and subject matter data of a hyper- 
video clip in conjunction with information specifying 
a message theme and a name of a notice board 
page, each of said hypvervideo messages being 
configured in a predetermined format said 
hypvervideo message posting processing means 
(160) including: 

hypervideo message data distribution means 
(163) for supplying said subject matter data 
data and scenario data of a hypervideo mes- 
sage to said second data service means (151) 
to be stored as scenario data and subject mat- 
ter data files in said second data storage 
means (151). and obtaining from said second 
data service means storage locating informa- 
tion for said message data contents, and 
notice board page updating processing means 
(163) for receiving from said hypervideo mes- 
sage data distribution means (162) said notice 
board name information and message theme 
information and said storage location informa- 
tion for said hypervideo message data con- 
tents, and for supplying said storage location 
information and message theme information to 
said first data service means to thereby update 
a notice board page which is specified by said 
notice board name information, by inserting 
said message theme information into said 
notice board page with said message theme 
information having a hyperlink connection to 
said scenario data and subject matter data 
files. 

56. An information provider apparatus according to 
claim 55, wherein said hypervideo mail generating 
means (1 80) , said data input/output means 1 1 0 and 
said information browsing means (120) in combina- 
tion constitute a client terminal, and wherein said 



hypervideo mail processing means (170), first data 
service means (130), second data service means 
(150) and hypervideo message posting processing 
means (160) in combination constitute a server 
5 computer, said client terminal and server computer 

being mutually connected by said data communica- 
tion path (140). 

57. An information provider apparatus according to 
w claim 56, comprising a plurality of said client termi- 
nals each connected to said server computer by 
said data communication path (140) for mutually 
independently communicating with said server 
computer, with at least one of said client terminals 

15 comprising hypvervideo message generating 
means controllable for generating arbitrary 
hypvervideo messages and sending said 
hypvervideo messages to said server computer via 
said data communication path (140) to said local 

20 area network, said data communication path being 
configured as a network data communication path, 

58. An information provider apparatus according to 
claim 57, comprising a wide-area network having a 

25 plurality of local area networks, each comprising a 
plurality of said client terminals and a server com- 
puter mutually connected by a network data com- 
munication path (140), and an inter-network data 
communication path (1194) interconnecting 

30 respective server computers of said local area net- 
works, wherein said client terminals of a local area 
network transmit hypvervideo messages only to the 
server computer of said local area network, each of 
said server computers further including wide-area 

35 distribution processing means (2180), said wide- 
area distribution processing means (2180) compris- 
ing: 

means responsive to posting of a hypervideo 
40 message by said server computer for distribut- 

ing said hypervideo message, via said inter- 
server data communication path (1194), to 
each of a predetermined set of other server 
computers of said wide-area network, and 
45 means responsive to receiving, via said inter- 

network data communication path (1194), a 
distributed hypervideo message, for executing 
processing to post said distributed hypervideo 
message in a notice board page which is spec- 
50 Hied by said notice board name information of 

said hypervideo message. 

59. An information provider apparatus according to 
claim 58, wherein said wide-area distribution 

55 processing means (2180) of a server computer 
comprises: 

distribution memory means (2182) having 
stored therein information specifying, for each 
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of respective notice board pages assigned in 
said first data service means (130) of said 
server computer, respective names of other 
server computers to which are predetermined 
as distribution destination server computers for 5 
said notice board page; 
message posting detection means (2181) cou- 
pled to said hypervideo message posting 
processing means (160), responsive to execu- 
tion of processing to post a hypervideo mes- 10 
sage by said hypervideo message posting 
processing means (160) for generating detec- 
tion result data corresponding to said hyper- 
video message, said detection result data 
specifying at least information specifying the is 
message theme of said hypervideo message 
and a name of a notice board page on which 
said hypervideo message was posted; 
distribution transmitting means (2183) coupled 
to receive said detection result data from said 20 
message posting detection means (2181), for 
obtaining from said distribution condition mem- 
ory (2182) respective names of said distribu- 
tion destination server computers 
corresponding to said notice board page, and 25 
for transmitting said hypervideo message to 
each of said distribution destination server 
computers, via said inter-server data communi- 
cation path (1 1 94), and 

distributed message data receiving means 30 
(2184) for receiving distributed hypervideo 
messages transmitted thereto via said inter- 
« server data communication path (1194) for 
configuring each said distributed hypervideo 
message in said predetermined format and 35 
supplying said distributed hypervideo message 
to said hypervideo message posting process- 
ing means (160). 

60. An information provider apparatus according to 40 
claim 59, wherein said distribution transmitting 
means (2183) comprises means for executing 
transmission of a hypervideo message to a distribu- 
tion destination server computer via said inter- 
server data communication path (1 1 94) by: 45 

creating a header file containing said notice 
board name information and message theme 
information of said hypervideo message, 
obtaining from said second data service means so 
'(150) the scenario data file and subject matter 
data files of said hypervideo message, 
transmitting the data contents of each of said 
header file, scenario data file and subject mat- 
ter data files to said distribution destination 55 
server computer via said inter-server data com- 
munication path (1194) by direct data transfer, 
using a wide-area network file transfer protocol 
(FTP), 



and wherein said distributed message data 
receiving means (2184) comprises means for 
processing the data of a hypervideo message 
received via said inter-server data communica- 
tion path (1 194) by: 

obtaining from said header file said notice 
board name information and message theme 
information, and combining said notice board 
name and message theme information with the 
data contents of said scenario data file and 
subject matter data files to configure said 
hypervideo message in said predetermined for- 
mat, and supplying a resultant hypervideo 
message to said hypervideo message posting 
processing means (160). 

L An information provider apparatus according to 
claim 59, wherein said distribution transmitting 
means (2183) comprises means for executing 
transmission of a hypervideo message by a server 
computer via said inter-network data communica- 
tion path (1194) by: 

obtaining storage position information for said 
scenario data and subject matter data files of 
said hypervideo message, with respect to said 
second data service means (150), to generate 
message updating information containing said 
storage position information together with said 
notice board name information and message 
theme information, and 

transmitting said message updating informa- 
tion via said inter-server data communication 
path (1194) to said distribution destination 
server computer; 

and wherein said distributed message data 
receiving means (2184) comprises means for 
processing said message updating information - 
of a hypervideo message, received via said 
inter-server data communication path (11 94), 
by: 

obtaining from said message updating informa- 
tion said storage position information which is 
contained therein; 

obtaining the data contents of said scenario 
data file and subject matter data files of said 
hypervideo message by direct data transfer via 
said inter-server data communication path 
(1 194) using a wide-area network file transfer 
protocol (FTP), from a server computer which 
originated said message updating information, 
obtaining, from said message updating infor- 
mation, said notice board name information 
and message theme information which are 
contained therein, and combining said notice 
board name and message theme information 
with the data contents of said scenario data file 
and subject matter data files to configure said 
hypervideo message in said predetermined for- 
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mat, and supplying a resultant hypervideo 
message to said hypervideo message posting 
processing means (160). 

62. An information provider apparatus according to s 
claim 61, wherein each of said server computers 
comprises temporary data storage means for hold- 
ing said message updating information, when said 
message updating information are received via said 
inter-server data communication path (1 1 94), 10 
wherein said means for processing said message 
updating information by said distributed message 
data receiving means (2184) performs said 
processing by executing a specific program, and 
wherein said each server computer further com- is 
prises: 

scheduling memory means (2191) for storing 
schedule data which specify scheduled times 
of execution of at least said specific program; 20 
scheduling execution means (2192) coupled to 
said distributed message data receiving means 
(2184), for controlling said distributed message 
data receiving means (2184) to initiate said 
processing of message updating information 25 
which is held in said temporary data storage 
means, at a time determined by said schedule 
data. 

63. An information provider apparatus according to 30 
claim 59, wherein said distribution transmitting 
means (2183) comprises: 

means for encoding said hypervideo message 
corresponding to said detection result data, to 35 
obtain an encoded hypervideo message hav- 
ing the form of an electronic mail item, by creat- 
ing a header file containing said notice board 
name and message theme information from 
said detection result data, and encoding said 40 
header file together with the scenario data and 
subject matter data files of the hypervideo mes- 
sage corresponding to said detection result 
data, and 

means for transmitting said encoded hyper- 45 
video message to each of said distribution des- 
tination server computers via said inter-server 
data communication path (1194) by using an 
electronic mail transfer communication protocol 
which is designed for transfer of electronic mail 50 
items within a wide-area network, 
and wherein said distributed message data 
receiving means (2184) comprises means for 
decoding an encoded hypervideo message 
which is received via said inter-network data 55 
communication path (1194), to obtain said 
header file, scenario data file and subject mat- 
ter data files, for configuring the data of said 
header file, scenario data file and subject mat- 



ter data files in said predetermined format, and 
supplying a resultant hypervideo message to 
said hypervideo message posting processing 
means (160). 

An information provider apparatus according to 
claim 63, wherein said encoding is Multi-purpose 
Internet Mail Extensions (MIME) encoding, and 
wherein said electronic mail transfer communica- 
tion protocol is the Simple Mail Transfer Protocol 
(SMTP). 

An information provider apparatus according to 
claim 58. wherein said distribution transmitting 
means (2183) is formed of a 1st distribution trans- 
mitting means (2183a) and a 2nd distribution trans- 
mitting means (2183b), and said distributed 
message data receiving means (2184) is formed of 
a 1st distributed message data receiving means 
(2184a) and a 2nd distributed message data receiv- 
ing means (21 84b), 

said 1 st distribution transmitting means 
(2183a) comprising means for obtaining stor- 
age position information for said scenario data 
and subject matter data files of said hypervideo 
message, with respect to said second data 
service means (150). to generate message 
updating information containing said storage 
position information together with said notice 
board name information and message theme 
information which are conveyed by said detec- 
tion result data, and means for transmitting 
said message updating information via said 
inter-server data communication path (1 194) to 
each said distribution destination server com- 
puter, 

said 1st distributed message data receiving 
means (2184a) comprising means for process- 
ing said message updating information of a 
hypervideo message, received via said inter- 
server data communication path (1194), by 
obtaining from said message updating informa- 
tion said storage position information which is 
contained therein, obtaining the data contents 
of said scenario data file and subject matter 
data files of said hypervideo message by direct 
data transfer via said inter-server data commu- 
nication path (1194) from a server computer 
which originated said message updating infor- 
mation, using a wide-area network file transfer 
protocol (FTP), configuring the notice board 
name information and message theme infor- 
mation from said message updating informa- 
tion together with the contents of said scenario 
data file and subject matter data files in said 
predetermined format, and supplying a result- 
ant hypervideo message to said hypervideo 
message posting processing means (160), and 
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comprising means, functioning in the event of a 
failure to obtain said data contents of said sce- 
nario data file and subject matter data files of 
said hypervideo message by direct data trans- 
fer, for sending to said originating server com- 5 
puter via said inter-server data communication 
path (1 1 94) a request for retransmission of said 
hypervideo message, encoded in the form of 
an electronic mail item; 

said 2nd distribution transmitting means 10 
(2183b) comprising means functioning in 
response to receiving via said inter-server data 
communication path (1194) a request for 
retransmission of a hypervideo message which 
has been transmitted by said 1st distribution is 
transmitting means (2183a), for creating a 
header file containing said notice board name 
and message theme information from the 
detection result data of said hypervideo mes- 
sage, encoding said header file together with 20 
the scenario data and subject matter data files 
of said hypervideo message, as an encoded 
hypervideo message in the form of an elec- 
tronic mail item, and transmitting said encoded 
hypervideo message via said inter-server data 25 
communication path (1 194) using an electronic 
mail transfer communication protocol which is 
designed for transfer of electronic mail items 
within a wide-area network, to a distribution 
destination server computer which originated 30 
said request for retransmission, 
said 2nd distributed message data receiving 
means (21 84b) comprising means for decoding 
an encoded hypervideo message which is 
received via said inter-network data communi- 35 
cation path (1194), to obtain said header file, 
scenario data file and subject matter data files, 
for configuring the data of said header file, sce- 
nario data file and subject matter data files in 
said predetermined format, and supplying a 40 
resultant hypervideo message to said hyper- 
video message posting "processing means 
(160), and 

distributed message data input processing 
means (2185) coupled to receive data transmit- 45 
ted via said intra-network data communication 
path (1194), for notifying said 1st distributed 
message data receiving means (2184a) when 
said received data consist of message updat- 
ing information and for supplying said message so 
updating information to said 1st distributed 
message data receiving means (2184a), for 
notifying said 2nd distributed message data 
receiving means (2184b) when said received 
data consist of a distributed hypervideo mes- ss 
sage encoded as an electronic mail item and 
for supplying said encoded hypervideo mes- 
sage to said 2nd distributed message data 
receiving means (2184b), and for notifying said 



2nd distribution transmitting means (2183b) 
when said received data consist of a request 
for retransmission of a hypervideo message 
and for supplying said request to said 2nd dis- 
tribution transmitting means (2183b). 
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FIG. 38 



( start ) 



1 


r 


Hypervideo mail item Hm for user b is sent 
from client terminal CI to server A 
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Server A stores the hypervideo mail item Hm, 
then updates its stored WWW data (i.e. mail 
page for user b) jn accordance with the 
*mail destination" and *mai 1 subject* 
information in Hm. 
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User b, from terminal C2, accesses the general 
mail page stored at server A, then uses 
hyperlinks to access his own mail page, then 
to access (play) the contents of the 
hypervideo mail item Hm which is stored 
at server A. 
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Store the "mail contents" portion of the 
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storage section 151 






Update the contents of WWW data storage 
sect ion- 131 9 in accordance with "mail 
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information in hypervideo mail item 




r 



( END ) 



MSDOCID: <EP 075642OA2 I > 



111 



EP0 756 420 A2 



CD 
O 



to 

CO 



CO o 
"C7 — 

+-» 
* U 

3e CO 



= e 1 



U 





c 




o 




+-» 




o 




CD 




CO 




-M 




d 


CO 


CD 


<M 


E 


CO 


CD 




CO 




CO 








CO 




E 



CO 



CVI 
CO 





c 




o 








o 




CD 




CO 


CO 






CP 


CO 


CD 




co 




L. 




o 








CO 



CO +-» 
+j o 

CO CD 
T> CO 

O +-» 

CD cz 

"O CD 

e 

> CD 

L_ 

CD 

Cl C 
>. CO 



cz 
o 



CO 

o 



CO 



CVJ 

CD ' 

c cz 
_ — o 

CO — 
O l » +-» 

s— o o 

C u O) 

-O CO 



e cz> 
o 
o 

CO 



rt 



CO 



CO 
CL 



c: 




o 




+-» 




CO 




o 




c 




ZD 




E 




E 




O 




o 


E 




CD 


CL- 




h- 


CO 


h— 


>1 


ZIZ 


CO 



L. 



LO 



LO 



CO 
-M 

CO ■ 

o 

CD 

-o 



CD 
CL 



O 
CD 
CO 

CD 

CO 



t 

J 



CO c 
-M O 



o 

LO 



CZ 




O 








CO 




O 




cz 




=3 




E 




E 




O 


E 


O 


CD 




4-» 


CO 


CO 


Li_ 


>1 




CO 



CO ■ 

-o 
o 

CD 



O 
CD 
CO 

CD 
O 



CD 
Cl 



CO 





CVJ 




cvi 






cz 




cz 






cz 


o 


"\ 


O 
CO— - 


"~\ 


CO 
+-» 


o 


+-» 




+-* 




CO 


■+-* 






CO u 




"O 


o 


CD 




-O CD 






CD 


CO 




-CO 




CO 


CO 














cz — 




CD CD 




-o 


co 


— o 




i- oo 




CD 


cz 


CO i- 




— CO 




e 




3t +-» 




3 L- 




O 


>i 


o cz 




cr o 




cz 


CO 


1- o 








o 




CO o 




<C CO 






CL 



CO 
-M 

CO ■ 
TD 

O 
CD 



CD 
CZ 



CD 
CL 

3T CL 



CO 



1 



I 

J 



ZD CZ> 
CL*— 
i — 

Z3 

0 cz 
\ o 

— 

ZD -»-> 

01 O 
cz CD 

— CO 



it 



-4 



CO 




CO 


+ J 


\ 




CO 


CO CO 


+-* L. 




l_. 


=3 CO 




CL CO 


CL Cl 




CO CL 


CZ Cl 




CL 


— CO 




CZ* CO 



o 




CD 


CD 




C 












CO cz 


> 




CO O 


L. 




CD — 


CD 




O -M 


CL 




O o O 




CO 


L- CD 1 — - 


ZIZ 




CL CO i— 




CO 








E 








H— O 


cz 






O CD 


o 












cz i — 


• 2 


-M 




CD 


CD > 


CO 


>> 


E C 


O L_ 


cz 




CD O 


L_ CD 






CO- 


ZD CL 


+-» 


13 


CO +-» 


o >. 


CO 


cr 


cz o 


CO _c 


CD 


cz 


CO CD 




cz> 


CD 


E CO 



















c 






o 


c 






o 






cz 


u 




CD 


CD 


CO 




CO 




CZ 






o 


CO 


-M 




cz 


CO 




CD 


CO 


CO 


"O 


e 


CO 




L_ 


CD 




o 


O 






O 


CO 


cz 


L_ 


2 




CL 



oo 







o 




+-» 


CZ 


CO 


o 


c: c: 




— o 


+-» 


4-j 


o 


CO -M 


CD 


CD CO 


CO 


"O E 






CD 


— o 




— H— -O 


CO cz 


CO 









cz 






o 




O 




CO 




+-* 


CD 


CO 


CO 




CD 


cz 


1- 


U 






L_ 


— +-* 




ZD 


— CO 


cr 


O 


CO CD 


cz 


CO 


E-O 


CD 



112 



■NSDOCID: <EP 0756420A2 ( > 



EP 0 756 420 A2 



FIG. 41 

Mail destination 
information table 
612 

_ fL , 



Server computer 
name data 



Server name 


A 


Table of mai 1 
transmission 
dest i nat ions 


Dest i nat i on (user) 
of hypervideo mai 1 


Corresponding 
server 


a 


A 


-b 


B 


c 


B 


• • • 


• ♦ • 



113 



EP0 756 420 A2 



CD ^ 
lu o 



CC LU 
LU> 
CL.CC 
>- LU 



CD 



CO 

1^ 



LO 



> o 



<0 

© c 

CD O O 

~o — — 

3c l o 

* © © 

* CO © 



I 



o < 
© 



© 



© CZ 

© o 
© 

© © 



o 




CO 


© 


















> 




CO o 


1— 




© — 


© 




O + J 


CI 




O O 




© 


L. © 




E 


CL © 



L- C 

— o 

ZJ 

c: u 
© © 
© 

cz 

o +-» 

— cr 
+-» © 
© e 
c © 

— o> 

© tz 
© © 



$\1 

u: 



cc 



CZ 




o 




+-» 




o u 




© 




— © 











CO 



o 
© 

— -o © 
p> C — 
L. © © 
© CZ 

CL © 

>i L. £ 

-C © 1- 
> © 
L- I— -#-< 
© © 

-C © 

-M CZ 
O © 

O © 



O 
CO 









o 








CD 




© 










o 


i_ 


© 




o 




•4-* 




O 


O 


cz 


*- 


© 




_o 


© 



CD 



CD 
O l— 
© © 

— © c 
> O) o 
l_ .— 

© -M 

CL O 

>» © © 

I E (/) 



114 



snonm: <EP 



EP 0 756 420 A2 

FIG. 43 







CI ient 




terminal 






^CA2 


CI ient 


terminal 






CI ient 


^CA3 


terminal 







Mai 1 server 






computer A 



194 



T 



Loca I A rea 
Network Na 





^CBl 




CI ient 




termina 1 












Mai 1 server 
computer B 


CI ient 


^CB2 




terminal 










^CB3 




CI ient 




terminal 







Local Area 
Network Nb 



115 



EP 0 756 420 A2 



FIG. 44 




CI ient 
terminal 



- r : 

Local Area 
Network Nb 



116 



EP 0 756 420 A2 



<D 

CL 

E 

o , 



<D 

> 



CO CD 
3£ CO 



CO 



CP 

o 



c 
o 



o 

CD 
CO 



CD 

o 

o — 
CD > 

> s 



CD CO -M 

cl u 

>i CO CD 
m ~TD CO 









o 




-M 






d 


+-» 




CD 


CO 




G c: 


d 




CD O 






o> — 




z> 


CO -M 


CO 


cr 


c o 


CD 


c: 


CO CD 




CD 


E CO 



o 




CD 


CP 
















CO c 


> 




(0 o 






CD — 


CP 






cx 




o o 


>» 


CO 


i- CD 


re 


e 


CL CO 



CD 
-#-* 

CL 

o y 



CD 

> 



CO CD 
=5 CO 



CD 
LTD 



CD 
CO 



CD cz 
O O 

> 

O 
CD CD 
(0 CO 



CD 
O 
O — 
CD > 
*"0 L- 
— CD cz 
> CO o 

CP CO -I-* 
CL-M O 
CO CD 
3="0 CO 




o 


CD 


CP 


c 








CO C 


> 


CO o 


L. 


CP — 


CP — 


o 


Cl — 


o o 


>» CO 


I- CD 




CL CO 



CO 

o 

cz 
E 

E CD 
o 

O i — 
CO -JC 

+-» 

CO CO 
O CL 



CO 



CO 5 



CD E CD 
~ L_ CO 

CP =3 

CJ> -M x — 



CD 

oo 





CO 






c: 






+-» 






CO 




o 


l_ 




CP 


CD 






c 






CD 


£Z 


> 


CO 


O 


L_ 






CD 




+-» 


CL 




o 


>v 


CO 


CD 


ZIO 


E 


CO 




117 



iFiOOCAD: <FP 



07B6420A2 I > 



EP 0 756 420 A2 

FIG. 46 
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Client terminal CA1 accesses the destination 
enquiry management section 170 of server A, 
to obtain the destination server computer 
(server B) for the hypervideo mail, then 
transmits the hypervideo mail item Hm to 
server B 




r 



Server B receives that hypervideo mail item 
Hm, stores the "mail contents* portion of 
Hm in storage section 151, and updates its 
stored WWW data (i.e. mail page for user b) 
in accordance with the "mail destination" 
and "mail subject" information in the mail 
item, and the storage location of the mail 
item 



- — . i_ 

User b, from terminal CB1 f sccesses the 
general mail page stored at server B, then 
uses hyperlinks to access his own mail page, 
stored at server B, then to access (play) 
the contents of the hypervideo mail item Hm 
which is stored at server B. 
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Receive and temporarily store 
hypervideo mail data 



Store the ~mai I contents* portion 
of the received hypervideo mail 
item, in data storage section 151 
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Update the contents of WWW data storage 
section 131, in accordance with 
*ma i I dest i nat i on* and "ma i I sub ject* 
information in hypervideo mail item 
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FIG. 47B 

( START ~) 
i 



Receive mail destination information 
enquiry, from enquiry source, 
specifying destination (user) name 



i 



Refer to mail destination information table, 
to find name of server computer which 
corresponds to mail destination name 



i 



Send server computer name 
to enquiry source 
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( START ) 



Receive and temporarily 
store mai I data 



Hypervideo 
mai I 




SI 



Reference 
mai t 



Store the "mail contents" 
portion of the received 
hypervideo mail item, in 
data storage section 151 



-S3 



Generate a corresponding 
reference mai I item, and 
determine the appropriate 
destination server for 
the reference mai I- 



~S4 



S6 



Update the contents 
of WWW data storage 
section 131, in 
accordance with 
contents of 
reference mail item 



1 




Transmit th 
mai 1 item t 
dest i nation 


e reference 
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server 
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FIG. 56 



( START ) 



r- 1 

Hype rv i deo ma i 1 i t em 
from client terminal 


Hm for user b is sent 
CA1 to server A 


. . i 





Server A stores the hypervideo mail item Hm, 
uses the information table section 193 to 
find the destination server computer 
(server B) f then generates and transmits a 
corresponding reference mail item Rm to 
server B 



1 


r 


Server B receives that reference mail item 
Rm, and updates its stored WWW data 
(i.e. mail page for user b) in accordance 
with the reference mai 1 contents 


. .... i 





User b, from terminal CB1, accesses the 
general mail page stored at server B. then 
uses hyperlinks to access his own mail page, 
stored at server B, then to access (play) 
the contents of the hypervideo mail item Hm 
which is stored at server A. 



( END ) 
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FIG. 60 

( START ) 

SI 

_i- , t 

Hypervideo mail generating section of client 
terminal CAT sends hypervideo mail item to 
mail server HA 



S2 

± <L 

Hypervideo mail processing section of mail 
server HA sends hypervideo mail item by 
file access operation, via Internet, to 
hypervideo mail processing section of mail 
server HB 



S3 

i- <L 

Hypervideo mail item is stored in hypervideo 
data service section (150) of mail server HB, 
by hypervideo mail processing section 



S4 

± tL 

Data (i.e. mail page data) held in WWW service 
section (130) of mail server HB are updated, 
in accordance with mail destination 
information contained in hypervideo mail item 
and storage location of hypervideo mail item 
within hypervideo data service section (150) 
of mai I server HB 



S5 

± L 

User b, from terminal CB1, accesses the general 
mail page stored at server HB, then uses 
hyperlinks to access his own mail page, stored 
at server HB, then to access (play) the 
contents of the hypervideo mail item Hm 
which is stored at server HB. 



( END ) 
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( START ) 

— x — 



Hypervideo mail generating section of client terminal ^ 
CAT sends hypervideo mail item to mail server HA 

Hypervideo mail processing section of mail server HA 
stores hypervideo mail item within hypervideo data 
service section (150) of mail server HA, then 
generates reference mail item, besed on mail 
destination information contained in hypervideo mail 
item and storage location within hypervideo data 
service section (150) 

* U a 

Hypervideo mail processing section of mail server HA 
sends reference mail item, via Internet, to hypervideo 
mail processing section of mail server HB 

At subsequent time, hypervideo mail processing section ^ 
of mail server HB executes file access operation 
(using reference ma i I item information), via 
Internet, to mail server HA, to receive hypervideo 
mail item 

Hypervideo mail processing section of mail server 
HB stores hypervideo mail item in hypervideo data 
service section (150) of mail server HB 

t =t_ S6 

Data (i.e. mail gage data) held in WWW service section 
(130) of mail server HB are updated, in accordance with 
mail destination information contained in hypervideo 
mail item and storage location of hypervideo mail item 
within hypervideo data service section (150) of 
ma i I server HB 

t - „ 

User b, from terminal CB1, accesses the general mail 
page stored at server HB, then uses hyperlinks to 
access his own mail page, stored at server HB, then 
to access (play) the contents of the hypervideo mail 
item Hm which is stored at server HB. 



q end y 
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FIG. 64 



( ST * RT ^ 

-SI 



Hypervideo mail generating section of client terminal 
CAl sends hypervideo mail item to mail server HA 

i ~ 



— S2 

Hypervideo mail processing section of ma i I server HA 
encodes hypervideo mail item, using MIME code 

* , 

Hypervideo mail processing section of mail server HA 
sends encoded hypervideo mail item, as Internet 
mail (i.e. using SMTP) via Internet, to hypervideo 
mail processing section of mail server HB, then 
deletes the hypervideo mail item data from storage 



I 



Hypervideo ma i I processing section of mail server HB 
receives and decodes the hypervideo mail item, and 
stores decoded data in hypervideo data service 
section (150) 



-S4 



I 



??£^ ( 'i e - "J 1 ?' 1 P 896 data) he,d in service section 
(IdU; of mail server HB are updated, in accordance with 
mail destination information contained in hypervideo 
mail item and storage location of hypervideo mail item 
within hypervideo data service section (150) of 
mai I server HB 



User b, from terminal CB1. accesses the general mail 
page stored at server HB, then uses hyperlinks to 
access his own mail page, stored at server HB, then 
to access (play) the contents of the hypervideo mail 
item Hm which is stored at server HB. 

, * x 



-S6 



136 



EP 0 756 420 A2 



FIG. 65 

( START } 



Hypervideo mail generating 
section of client terminal 
CA1 sends hypervideo mai I 
item to mai I server HA 



KS1 



Hypervideo mai I processing 
section of mail server HA 
stores hypervideo mail 
item in hypervideo data 
service section (150), and 
generates corresponding 
reference mail item 



h-S2 



Hypervideo mail processing 
section of mail server 
HA sends reference mail 
item, via Internet, to 
Hypervideo mai I 
processing section of 
mai I server HB 



K-S3 



At subsequent time, 
hypervideo mail processing 
section of mail server HB 
uses reference mail item 
information to send to 
hypervideo mail processing 
section of mail server HA, 
via Internet, a request to 
"send hypervideo mail item, 
encoded using MIME -code*. 



KS4 



In response to request, 
hypervideo mail 
processing section of 
mail server HA encodes 
hypervideo mail item, 
usi ng MIME code 



^S5 



Hypervideo mail processing 
section of mail server HA 
sends encoded hypervideo 
mail item, as Internet 
mail (i.e. using SMTP) via 
Internet, to hypervideo 
mail processing section of 
mail server HB, then 
deletes the hypervideo 
mai I item data from 
storage 



KS6 



Hypervideo mail processing 
section of mai I server HB 
receives and decodes the 
hypervideo mai I item, and 
stores decoded data in 
hypervideo data service 
section (150) 



-S7 



Data (i.e. mail page data) 
held in WWW service 
section (130) of mail 
server HB are updated, i n 
accordance with mai I 
dest i nat i on i nf ormat i on 
contained in hypervideo 
mail item and storage 
location of hypervideo 
mai I item within 
hypervideo data service 
section (150) of mail 
server HB 
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User b, from terminal CB1, 
accesses the general mail 
page stored at server HB, 
then uses hyperlinks to 
access his own mai I page, 
stored at server HB, then 
to access (play) the 
contents of the hypervideo 
mail item Hm which is 
stored at server HB. 

( END ) 
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FIG. 68 
PRIOR ART 



Playing control table of 
information browsing section 

^ . 



Fi le 

extension 


Data type 


Player program 


. htm! 


HTML 

(hypertext) 




. gif 


GIF 

(st i 1 1 picture) 


XV 


- mpeg 


MPEG 
(v ideo) 


mpeg -pi- ay 
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FIG. 69 
PRIOR ART 



C 



START 



Display the home page 



Receive selection input 
from user 



ST. 3 



ST. 1 



-ST. 2 




c 



Display (play) the data 
selected by the user 



141 



EP 0 756 420 A2 



FIG. 70 
PRIOR ART 



( START ) 

T 



Acquire and dispfay 
the home page 



Wait for a selection 
input 



ST. 13 



Acquire the selected 
WWW data 



Hypertext 
data (HTML) 



Display the 
text data 



-ST. 1 1 



-ST. 1 2 




( END 



-ST. 1 4 




Monomedia data 
(MPEG, GIF,..) 



Activate the monomedia 
player 



-ST. 1 7 
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FIG. 78 A 



FIG. 



(Within server compui 


ter A) 


Name of noticeboard 
which is subject to 
distr ibut ion 


Name of server computers 
to which noticeboard 
is distributed 


"New Products 
Guide' 


B, C 


















J D 

(Within server compul 


:er B) 


Name of noticeboard 
which is subject to 
distribution 


Names of server computers 
to which noticeboard 
is distributed 


"New Products 
Guide" 


A, C 



















FIG. 78C 

(Within server computer C) 



Name of noticeboard 
which is subject to 
distribution 


Names of server computers 
to which noticeboard 
is distributed 


"New Products 
Guide" 


A, B 
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FIG. 79 



DISTRIBUTION 
FILE GROUP 



(Header file) 



(Scenario data 
file) 



(Subject matter 
data f i les) 
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FIG. 80 

( START ) 

ST. 1 



1 

Server computer A 
processing of a h 


executes post i ng 
ypervideo message 


_ i 


ST, 2 


Server computer A detects the host computers 
(B, C) which are distribution hosts for 
the notice board on which the message has 
been posted 




ST. 3 


Server computer A distributes the newly 
posted message to each of the distribution 
hosts (B, C) 




ST. 4 


Each of host compute 
post i ng process i ng c 


>rs B and C executes 
>f the message. 
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FIG. 81 



( START ) 



1 


ST. 1 


Receive, from the posting result detection 
section 2181, detection result data 2701 
indicating that a hypervideo message has 
been posted 




ST. 2 


Look up the distribution condition table 
stored in the distribution condition 
memory 2182, to find the names of the of 
the server computers (B, C) to which the 
message is to be distributed, by finding 
the names of the host computers which 
correspond to the notice board where the 
message has been posted 




ST. 3 


Generate a header file 2703 based on the 
detection result data 2701 




ST. 4 

f 


Transmit the distribution file group to the 
distribution hosts, using FTP data transfer 




f 
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FIG. 82 



( START ) 



1 


ST. 1 


Receive all of the distribution file group 
of a distributed hypervideo message 




ST. 2 

«> 


Determine the "Noticeboard Name" and 
"Message theme* data, from the header 
file 2703, and reconstruct the 
hypervideo message from the scenario 
file 2704 and subject matter data 
f i les 2705 




ST. 3 

? 


Supply to the hypervideo message posting 
processing section 160 a request to post 
that hypervideo message 




r. 
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FIG. 84 

.2801 



Notice board 
name 


"New Products 
Guide" 


Message 
theme 


* 29 -inch 
Wide -Screen TV 


List of 
stored f i les 




A:/HV/new/29tv. sci 
A:/HV/new/29tv. mpeg 
A:/HV/new/29tv. gif 
A : /HV/new/29tv. text 
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FIG. 85 

(_ START ) 



1 


ST. 1 

> 


Receive from posting result detection section 
the data indicating detected result of 
posting processing of hypervideo message 




ST. 2 


Look up the distribution condition memory 
to find the names (B, C) of distribution 
host computers corresponding to 
detection result data 




ST. 3 


Based on the detection result data, refer to the 
storage position information for hypervideo data 
stored in hypervideo data service section 150, 
to generate the message updating information 




ST. 4 


Transmit the message updating information 
to distribution destination host computers 
(B f C), using SMTP 







C_2LD 
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FIG. 86 



( START ) 



1 


ST. 1 


Receive message updating information 2801 




ST. 2 

? 


Refer to the *List of Stored Files* in the 
message updating information 2801, use FTP 
to acquire these files from the 
distribution server computer 




ST. 3 
<> 


Reconstruct the message, based on the 
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FIG. 93 
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FIG. 94 
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FIG. 98 A 
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FIG. 99 
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FIG. 104 
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